2019-01-17 13:25:12 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-17 13:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:25:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:25:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:25:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:25:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:25:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:25:23 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-17 13:25:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 13:25:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 13:26:05 [DEBUG   ] Got command RPT from MCS: ref #1196610
2019-01-17 13:26:05 [DEBUG   ] summary = ERROR
2019-01-17 13:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196610  13 58500 48365657 A  ERRORERROR'
2019-01-17 13:26:05 [DEBUG   ] Got command RPT from MCS: ref #1196611
2019-01-17 13:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196611  77 58500 48365658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:26:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 13:26:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-17 13:26:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 13:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:26:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:26:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:26:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:26:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:26:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:26:23 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-17 13:26:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:26:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 13:27:07 [DEBUG   ] Got command RPT from MCS: ref #1196629
2019-01-17 13:27:07 [DEBUG   ] summary = ERROR
2019-01-17 13:27:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196629  13 58500 48427841 A  ERRORERROR'
2019-01-17 13:27:08 [DEBUG   ] Got command RPT from MCS: ref #1196630
2019-01-17 13:27:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:27:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196630  77 58500 48428033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:27:08 [DEBUG   ] Got command RPT from MCS: ref #1196631
2019-01-17 13:27:08 [DEBUG   ] summary = ERROR
2019-01-17 13:27:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196631  13 58500 48428237 A  ERRORERROR'
2019-01-17 13:27:08 [DEBUG   ] Got command RPT from MCS: ref #1196633
2019-01-17 13:27:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:27:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196633  77 58500 48428441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:27:08 [DEBUG   ] Got command RPT from MCS: ref #1196634
2019-01-17 13:27:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 13:27:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196634  12 58500 48428633 A  ERRORB—™š'
2019-01-17 13:27:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 13:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:27:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:27:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:27:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:27:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:27:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:27:23 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-17 13:27:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:27:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:28:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 13:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:28:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:28:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:28:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:28:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:28:23 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-17 13:28:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 13:28:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:29:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:29:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:29:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:29:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:29:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:29:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:29:23 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-17 13:29:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 13:29:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 13:30:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 13:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:30:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:30:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:30:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:30:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:30:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:30:23 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-17 13:30:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 13:30:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 13:31:05 [DEBUG   ] Got command RPT from MCS: ref #1196647
2019-01-17 13:31:05 [DEBUG   ] summary = ERROR
2019-01-17 13:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196647  13 58500 48665653 A  ERRORERROR'
2019-01-17 13:31:05 [DEBUG   ] Got command RPT from MCS: ref #1196648
2019-01-17 13:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196648  77 58500 48665654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:31:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 13:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:31:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:31:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:31:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:31:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:31:23 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-17 13:31:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:31:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 13:32:07 [DEBUG   ] Got command RPT from MCS: ref #1196664
2019-01-17 13:32:07 [DEBUG   ] summary = ERROR
2019-01-17 13:32:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196664  13 58500 48727921 A  ERRORERROR'
2019-01-17 13:32:08 [DEBUG   ] Got command RPT from MCS: ref #1196665
2019-01-17 13:32:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:32:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196665  77 58500 48728125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:32:08 [DEBUG   ] Got command RPT from MCS: ref #1196666
2019-01-17 13:32:08 [DEBUG   ] summary = ERROR
2019-01-17 13:32:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196666  13 58500 48728317 A  ERRORERROR'
2019-01-17 13:32:08 [DEBUG   ] Got command RPT from MCS: ref #1196667
2019-01-17 13:32:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:32:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196667  77 58500 48728521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:32:08 [DEBUG   ] Got command RPT from MCS: ref #1196668
2019-01-17 13:32:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 13:32:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196668  12 58500 48728725 A  ERRORB–™š'
2019-01-17 13:32:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 13:32:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:32:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 13:32:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:32:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:32:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:32:23 [WARNING ] (13, 1, 'bot')
2019-01-17 13:32:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:32:23 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-01-17 13:32:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 13:32:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 13:33:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 13:33:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:33:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:33:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:33:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:33:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:33:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:33:24 [DEBUG   ] Finished updating board flags in 2.177 seconds
2019-01-17 13:33:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 13:33:54 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 13:34:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 13:34:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:34:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:34:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:34:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:34:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:34:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:34:24 [DEBUG   ] Finished updating board flags in 1.703 seconds
2019-01-17 13:34:34 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2019-01-17 13:34:54 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-17 13:35:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 13:35:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:35:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 13:35:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:35:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:35:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:35:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:35:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:35:24 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-01-17 13:35:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 13:35:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 13:36:05 [DEBUG   ] Got command RPT from MCS: ref #1196673
2019-01-17 13:36:05 [DEBUG   ] summary = ERROR
2019-01-17 13:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196673  13 58500 48965649 A  ERRORERROR'
2019-01-17 13:36:05 [DEBUG   ] Got command RPT from MCS: ref #1196674
2019-01-17 13:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196674  77 58500 48965650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:36:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:36:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:36:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:36:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:36:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:36:24 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-17 13:36:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:36:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 13:37:08 [DEBUG   ] Got command RPT from MCS: ref #1196696
2019-01-17 13:37:08 [DEBUG   ] summary = ERROR
2019-01-17 13:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196696  13 58500 49028001 A  ERRORERROR'
2019-01-17 13:37:08 [DEBUG   ] Got command RPT from MCS: ref #1196697
2019-01-17 13:37:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196697  77 58500 49028205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:37:08 [DEBUG   ] Got command RPT from MCS: ref #1196698
2019-01-17 13:37:08 [DEBUG   ] summary = ERROR
2019-01-17 13:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196698  13 58500 49028397 A  ERRORERROR'
2019-01-17 13:37:08 [DEBUG   ] Got command RPT from MCS: ref #1196700
2019-01-17 13:37:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196700  77 58500 49028601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:37:08 [DEBUG   ] Got command RPT from MCS: ref #1196702
2019-01-17 13:37:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 13:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196702  12 58500 49028805 A  ERRORB–™š'
2019-01-17 13:37:11 [DEBUG   ] Got command TBW from MCS: ref #1196707
2019-01-17 13:37:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-17 13:37:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1196707   8 58500 49031821 A  ERROR'
2019-01-17 13:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-17 13:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-17 13:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-17 13:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-17 13:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-17 13:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-17 13:37:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-17 13:37:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-17 13:37:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-17 13:37:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-17 13:37:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-17 13:37:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-17 13:37:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-17 13:37:15 [DEBUG   ] spawn_process: at 2019-01-17 13:37:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-17 13:37:15 [INFO    ] Finished spawning TBW
2019-01-17 13:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:37:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:37:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:37:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:37:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:37:24 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-01-17 13:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:38:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:38:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:38:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:38:24 [WARNING ] (13, 1, 'bot')
2019-01-17 13:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:38:24 [DEBUG   ] Finished updating board flags in 1.347 seconds
2019-01-17 13:39:03 [INFO    ] __waitForTBW - TBW finished in 108.499 s
2019-01-17 13:39:04 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-01-17 13:39:04 [INFO    ] Started antennas statistics background thread
2019-01-17 13:39:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547732346']
2019-01-17 13:39:04 [DEBUG   ] spawn_process: at 2019-01-17 13:39:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547732346']
2019-01-17 13:39:04 [INFO    ] Finished spawning TBN in 0.051 s
2019-01-17 13:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:39:25 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-01-17 13:39:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2019-01-17 13:39:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 13:40:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 13:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:40:25 [DEBUG   ] Finished updating ant stats in 1.057 seconds
2019-01-17 13:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:40:25 [DEBUG   ] Finished updating board flags in 2.383 seconds
2019-01-17 13:40:45 [DEBUG   ] Finished updating ant stats in 0.946 seconds
2019-01-17 13:41:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 13:41:05 [DEBUG   ] Got command RPT from MCS: ref #1196719
2019-01-17 13:41:05 [DEBUG   ] summary = ERROR
2019-01-17 13:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196719  13 58500 49265661 A  ERRORERROR'
2019-01-17 13:41:05 [DEBUG   ] Got command RPT from MCS: ref #1196720
2019-01-17 13:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196720  77 58500 49265662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:41:25 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-01-17 13:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:41:25 [DEBUG   ] Finished updating board flags in 2.072 seconds
2019-01-17 13:41:45 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2019-01-17 13:42:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 13:42:08 [DEBUG   ] Got command RPT from MCS: ref #1196736
2019-01-17 13:42:08 [DEBUG   ] summary = ERROR
2019-01-17 13:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196736  13 58500 49328085 A  ERRORERROR'
2019-01-17 13:42:08 [DEBUG   ] Got command RPT from MCS: ref #1196737
2019-01-17 13:42:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196737  77 58500 49328277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:42:08 [DEBUG   ] Got command RPT from MCS: ref #1196738
2019-01-17 13:42:08 [DEBUG   ] summary = ERROR
2019-01-17 13:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196738  13 58500 49328481 A  ERRORERROR'
2019-01-17 13:42:08 [DEBUG   ] Got command RPT from MCS: ref #1196739
2019-01-17 13:42:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196739  77 58500 49328685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:42:08 [DEBUG   ] Got command RPT from MCS: ref #1196740
2019-01-17 13:42:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 13:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196740  12 58500 49328889 A  ERRORB˜™š'
2019-01-17 13:42:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 13:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:42:25 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-17 13:42:26 [DEBUG   ] Finished updating ant stats in 1.595 seconds
2019-01-17 13:42:46 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-01-17 13:43:05 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-01-17 13:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:43:25 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2019-01-17 13:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:43:25 [DEBUG   ] Finished updating board flags in 2.017 seconds
2019-01-17 13:43:46 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2019-01-17 13:44:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 13:44:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:44:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 13:44:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:44:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:44:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:44:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:44:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:44:26 [DEBUG   ] Finished updating board flags in 3.068 seconds
2019-01-17 13:44:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 13:45:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:45:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:45:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:45:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:45:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:45:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:45:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:45:25 [DEBUG   ] Finished updating board flags in 1.870 seconds
2019-01-17 13:45:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 13:45:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 13:46:05 [DEBUG   ] Got command RPT from MCS: ref #1196749
2019-01-17 13:46:05 [DEBUG   ] summary = ERROR
2019-01-17 13:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196749  13 58500 49565657 A  ERRORERROR'
2019-01-17 13:46:05 [DEBUG   ] Got command RPT from MCS: ref #1196750
2019-01-17 13:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196750  77 58500 49565658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:46:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 13:46:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:46:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:46:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:46:26 [DEBUG   ] Finished updating board flags in 2.528 seconds
2019-01-17 13:46:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:47:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 13:47:08 [DEBUG   ] Got command RPT from MCS: ref #1196768
2019-01-17 13:47:08 [DEBUG   ] summary = ERROR
2019-01-17 13:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196768  13 58500 49628161 A  ERRORERROR'
2019-01-17 13:47:08 [DEBUG   ] Got command RPT from MCS: ref #1196769
2019-01-17 13:47:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196769  77 58500 49628365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:47:08 [DEBUG   ] Got command RPT from MCS: ref #1196770
2019-01-17 13:47:08 [DEBUG   ] summary = ERROR
2019-01-17 13:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196770  13 58500 49628557 A  ERRORERROR'
2019-01-17 13:47:08 [DEBUG   ] Got command RPT from MCS: ref #1196772
2019-01-17 13:47:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196772  77 58500 49628761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:47:08 [DEBUG   ] Got command RPT from MCS: ref #1196774
2019-01-17 13:47:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 13:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196774  12 58500 49628965 A  ERRORB—™š'
2019-01-17 13:47:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:47:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:47:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:47:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:47:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:47:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:47:25 [DEBUG   ] Finished updating board flags in 1.665 seconds
2019-01-17 13:47:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 13:47:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 13:48:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 13:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:48:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:48:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:48:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:48:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:48:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:48:25 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-17 13:48:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 13:48:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 13:49:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 13:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:49:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:49:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:49:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:49:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:49:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:49:25 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-17 13:49:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 13:49:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 13:50:07 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 13:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:50:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 13:50:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:50:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:50:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:50:25 [WARNING ] (13, 1, 'bot')
2019-01-17 13:50:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:50:25 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-17 13:50:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 13:50:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 13:51:05 [DEBUG   ] Got command RPT from MCS: ref #1196782
2019-01-17 13:51:05 [DEBUG   ] summary = ERROR
2019-01-17 13:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196782  13 58500 49865653 A  ERRORERROR'
2019-01-17 13:51:05 [DEBUG   ] Got command RPT from MCS: ref #1196783
2019-01-17 13:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196783  77 58500 49865654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:51:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 13:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:51:26 [DEBUG   ] Finished updating board flags in 2.244 seconds
2019-01-17 13:51:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 13:51:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 13:52:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 13:52:08 [DEBUG   ] Got command RPT from MCS: ref #1196803
2019-01-17 13:52:08 [DEBUG   ] summary = ERROR
2019-01-17 13:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196803  13 58500 49928237 A  ERRORERROR'
2019-01-17 13:52:08 [DEBUG   ] Got command RPT from MCS: ref #1196804
2019-01-17 13:52:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196804  77 58500 49928441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:52:08 [DEBUG   ] Got command RPT from MCS: ref #1196805
2019-01-17 13:52:08 [DEBUG   ] summary = ERROR
2019-01-17 13:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196805  13 58500 49928645 A  ERRORERROR'
2019-01-17 13:52:08 [DEBUG   ] Got command RPT from MCS: ref #1196806
2019-01-17 13:52:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196806  77 58500 49928849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:52:09 [DEBUG   ] Got command RPT from MCS: ref #1196807
2019-01-17 13:52:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 13:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196807  12 58500 49929041 A  ERRORB–™š'
2019-01-17 13:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:52:26 [DEBUG   ] Finished updating board flags in 2.190 seconds
2019-01-17 13:52:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 13:52:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:53:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:53:26 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-17 13:53:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 13:53:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 13:54:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 13:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:54:26 [DEBUG   ] Finished updating board flags in 1.950 seconds
2019-01-17 13:54:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 13:54:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 13:55:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 13:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:55:26 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-17 13:55:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 13:55:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 13:56:05 [DEBUG   ] Got command RPT from MCS: ref #1196815
2019-01-17 13:56:05 [DEBUG   ] summary = ERROR
2019-01-17 13:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196815  13 58500 50165654 A  ERRORERROR'
2019-01-17 13:56:05 [DEBUG   ] Got command RPT from MCS: ref #1196816
2019-01-17 13:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196816  77 58500 50165654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:56:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 13:56:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 13:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:56:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 13:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:56:26 [DEBUG   ] Finished updating board flags in 1.913 seconds
2019-01-17 13:56:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 13:56:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:57:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 13:57:08 [DEBUG   ] Got command RPT from MCS: ref #1196836
2019-01-17 13:57:08 [DEBUG   ] summary = ERROR
2019-01-17 13:57:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196836  13 58500 50228321 A  ERRORERROR'
2019-01-17 13:57:08 [DEBUG   ] Got command RPT from MCS: ref #1196837
2019-01-17 13:57:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:57:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196837  77 58500 50228525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:57:08 [DEBUG   ] Got command RPT from MCS: ref #1196838
2019-01-17 13:57:08 [DEBUG   ] summary = ERROR
2019-01-17 13:57:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196838  13 58500 50228729 A  ERRORERROR'
2019-01-17 13:57:08 [DEBUG   ] Got command RPT from MCS: ref #1196840
2019-01-17 13:57:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 13:57:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196840  77 58500 50228921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 13:57:09 [DEBUG   ] Got command RPT from MCS: ref #1196841
2019-01-17 13:57:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 13:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196841  12 58500 50229125 A  ERRORB—™š'
2019-01-17 13:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:57:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:57:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:57:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:57:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:57:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:57:26 [DEBUG   ] Finished updating board flags in 1.689 seconds
2019-01-17 13:57:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 13:57:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 13:58:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 13:58:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:58:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 13:58:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:58:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:58:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:58:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:58:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:58:26 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-17 13:58:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 13:58:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 13:59:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 13:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 13:59:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:59:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:59:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:59:26 [WARNING ] (13, 1, 'bot')
2019-01-17 13:59:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 13:59:26 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-17 13:59:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 13:59:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:00:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 14:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:00:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:00:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:00:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:00:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:00:26 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-17 14:00:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 14:00:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 14:01:05 [DEBUG   ] Got command RPT from MCS: ref #1196859
2019-01-17 14:01:05 [DEBUG   ] summary = ERROR
2019-01-17 14:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196859  13 58500 50465653 A  ERRORERROR'
2019-01-17 14:01:05 [DEBUG   ] Got command RPT from MCS: ref #1196860
2019-01-17 14:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196860  77 58500 50465654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:01:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 14:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:01:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 14:01:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:01:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:01:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:01:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:01:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:01:26 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-17 14:01:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 14:01:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:02:08 [DEBUG   ] Got command RPT from MCS: ref #1196876
2019-01-17 14:02:08 [DEBUG   ] summary = ERROR
2019-01-17 14:02:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196876  13 58500 50528409 A  ERRORERROR'
2019-01-17 14:02:08 [DEBUG   ] Got command RPT from MCS: ref #1196877
2019-01-17 14:02:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:02:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196877  77 58500 50528601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:02:08 [DEBUG   ] Got command RPT from MCS: ref #1196878
2019-01-17 14:02:08 [DEBUG   ] summary = ERROR
2019-01-17 14:02:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196878  13 58500 50528805 A  ERRORERROR'
2019-01-17 14:02:09 [DEBUG   ] Got command RPT from MCS: ref #1196879
2019-01-17 14:02:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196879  77 58500 50529009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:02:09 [DEBUG   ] Got command RPT from MCS: ref #1196880
2019-01-17 14:02:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196880  12 58500 50529201 A  ERRORB–™š'
2019-01-17 14:02:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:02:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:02:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:02:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:02:26 [WARNING ] (13, 1, 'bot')
2019-01-17 14:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:02:26 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-17 14:02:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:02:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:03:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:03:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:03:27 [DEBUG   ] Finished updating board flags in 2.221 seconds
2019-01-17 14:03:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:03:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:04:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:04:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:04:27 [DEBUG   ] Finished updating board flags in 2.294 seconds
2019-01-17 14:04:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 14:04:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 14:05:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 14:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:05:27 [DEBUG   ] Finished updating board flags in 2.096 seconds
2019-01-17 14:05:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:05:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 14:06:05 [DEBUG   ] Got command RPT from MCS: ref #1196885
2019-01-17 14:06:05 [DEBUG   ] summary = ERROR
2019-01-17 14:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196885  13 58500 50765657 A  ERRORERROR'
2019-01-17 14:06:05 [DEBUG   ] Got command RPT from MCS: ref #1196886
2019-01-17 14:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196886  77 58500 50765658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:06:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:06:27 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-17 14:06:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 14:06:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:07:08 [DEBUG   ] Got command RPT from MCS: ref #1196908
2019-01-17 14:07:08 [DEBUG   ] summary = ERROR
2019-01-17 14:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196908  13 58500 50828485 A  ERRORERROR'
2019-01-17 14:07:08 [DEBUG   ] Got command RPT from MCS: ref #1196909
2019-01-17 14:07:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196909  77 58500 50828689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:07:08 [DEBUG   ] Got command RPT from MCS: ref #1196910
2019-01-17 14:07:08 [DEBUG   ] summary = ERROR
2019-01-17 14:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196910  13 58500 50828881 A  ERRORERROR'
2019-01-17 14:07:09 [DEBUG   ] Got command RPT from MCS: ref #1196912
2019-01-17 14:07:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:07:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196912  77 58500 50829085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:07:09 [DEBUG   ] Got command RPT from MCS: ref #1196914
2019-01-17 14:07:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:07:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196914  12 58500 50829289 A  ERRORB–™š'
2019-01-17 14:07:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:07:27 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-17 14:07:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 14:07:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:08:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:08:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:08:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:08:27 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-17 14:08:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:08:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:09:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 14:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:09:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:09:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:09:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:09:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:09:27 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-17 14:09:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 14:09:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 14:10:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 14:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:10:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:10:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:10:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:10:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:10:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:10:27 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-17 14:10:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:10:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:11:05 [DEBUG   ] Got command RPT from MCS: ref #1196922
2019-01-17 14:11:05 [DEBUG   ] summary = ERROR
2019-01-17 14:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196922  13 58500 51065665 A  ERRORERROR'
2019-01-17 14:11:05 [DEBUG   ] Got command RPT from MCS: ref #1196923
2019-01-17 14:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196923  77 58500 51065666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:11:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:11:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 14:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:11:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:11:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:11:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:11:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:11:27 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-17 14:11:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 14:11:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:12:08 [DEBUG   ] Got command RPT from MCS: ref #1196939
2019-01-17 14:12:08 [DEBUG   ] summary = ERROR
2019-01-17 14:12:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196939  13 58500 51128569 A  ERRORERROR'
2019-01-17 14:12:08 [DEBUG   ] Got command RPT from MCS: ref #1196940
2019-01-17 14:12:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:12:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196940  77 58500 51128761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:12:08 [DEBUG   ] Got command RPT from MCS: ref #1196941
2019-01-17 14:12:08 [DEBUG   ] summary = ERROR
2019-01-17 14:12:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196941  13 58500 51128965 A  ERRORERROR'
2019-01-17 14:12:09 [DEBUG   ] Got command RPT from MCS: ref #1196942
2019-01-17 14:12:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196942  77 58500 51129169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:12:09 [DEBUG   ] Got command RPT from MCS: ref #1196943
2019-01-17 14:12:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196943  12 58500 51129373 A  ERRORB–™š'
2019-01-17 14:12:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:12:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:12:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:12:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:12:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:12:27 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-17 14:12:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:12:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 14:13:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:13:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:13:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:13:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:13:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:13:27 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-17 14:13:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:13:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:14:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 14:14:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:14:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 14:14:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:14:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:14:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:14:27 [WARNING ] (13, 1, 'bot')
2019-01-17 14:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:14:27 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-17 14:14:31 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-17 14:14:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:15:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:15:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:15:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:15:28 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-17 14:15:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:15:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:16:05 [DEBUG   ] Got command RPT from MCS: ref #1196952
2019-01-17 14:16:05 [DEBUG   ] summary = ERROR
2019-01-17 14:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196952  13 58500 51365661 A  ERRORERROR'
2019-01-17 14:16:05 [DEBUG   ] Got command RPT from MCS: ref #1196953
2019-01-17 14:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196953  77 58500 51365662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:16:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 14:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:16:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:16:28 [DEBUG   ] Finished updating board flags in 1.995 seconds
2019-01-17 14:16:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 14:16:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 14:17:08 [DEBUG   ] Got command RPT from MCS: ref #1196971
2019-01-17 14:17:08 [DEBUG   ] summary = ERROR
2019-01-17 14:17:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196971  13 58500 51428641 A  ERRORERROR'
2019-01-17 14:17:08 [DEBUG   ] Got command RPT from MCS: ref #1196972
2019-01-17 14:17:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:17:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196972  77 58500 51428845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:17:09 [DEBUG   ] Got command RPT from MCS: ref #1196973
2019-01-17 14:17:09 [DEBUG   ] summary = ERROR
2019-01-17 14:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196973  13 58500 51429049 A  ERRORERROR'
2019-01-17 14:17:09 [DEBUG   ] Got command RPT from MCS: ref #1196975
2019-01-17 14:17:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196975  77 58500 51429253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:17:09 [DEBUG   ] Got command RPT from MCS: ref #1196976
2019-01-17 14:17:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196976  12 58500 51429445 A  ERRORB—™š'
2019-01-17 14:17:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:17:28 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-17 14:17:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 14:17:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:18:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 14:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:18:28 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-17 14:18:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:18:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 14:19:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:19:28 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-17 14:19:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:19:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:20:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 14:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:20:28 [DEBUG   ] Finished updating board flags in 1.665 seconds
2019-01-17 14:20:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 14:20:51 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2019-01-17 14:21:05 [DEBUG   ] Got command RPT from MCS: ref #1196985
2019-01-17 14:21:05 [DEBUG   ] summary = ERROR
2019-01-17 14:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196985  13 58500 51665665 A  ERRORERROR'
2019-01-17 14:21:05 [DEBUG   ] Got command RPT from MCS: ref #1196986
2019-01-17 14:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1196986  77 58500 51665666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:21:11 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-01-17 14:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:21:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:21:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:21:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:21:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:21:28 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-17 14:21:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 14:21:52 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 14:22:08 [DEBUG   ] Got command RPT from MCS: ref #1197006
2019-01-17 14:22:08 [DEBUG   ] summary = ERROR
2019-01-17 14:22:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197006  13 58500 51728729 A  ERRORERROR'
2019-01-17 14:22:08 [DEBUG   ] Got command RPT from MCS: ref #1197007
2019-01-17 14:22:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:22:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197007  77 58500 51728933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:22:09 [DEBUG   ] Got command RPT from MCS: ref #1197008
2019-01-17 14:22:09 [DEBUG   ] summary = ERROR
2019-01-17 14:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197008  13 58500 51729125 A  ERRORERROR'
2019-01-17 14:22:09 [DEBUG   ] Got command RPT from MCS: ref #1197009
2019-01-17 14:22:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197009  77 58500 51729329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:22:09 [DEBUG   ] Got command RPT from MCS: ref #1197010
2019-01-17 14:22:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197010  12 58500 51729533 A  ERRORB–™š'
2019-01-17 14:22:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:22:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:22:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:22:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:22:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:22:28 [DEBUG   ] Finished updating board flags in 1.534 seconds
2019-01-17 14:22:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 14:22:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:23:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 14:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:23:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:23:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:23:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:23:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:23:28 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-17 14:23:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:23:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 14:24:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 14:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:24:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:24:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:24:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:24:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:24:28 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-17 14:24:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 14:24:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:25:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 14:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:25:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:25:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:25:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:25:28 [WARNING ] (13, 1, 'bot')
2019-01-17 14:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:25:28 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-17 14:25:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:25:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 14:26:05 [DEBUG   ] Got command RPT from MCS: ref #1197015
2019-01-17 14:26:05 [DEBUG   ] summary = ERROR
2019-01-17 14:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197015  13 58500 51965661 A  ERRORERROR'
2019-01-17 14:26:05 [DEBUG   ] Got command RPT from MCS: ref #1197016
2019-01-17 14:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197016  77 58500 51965662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:26:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:26:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:26:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:26:29 [DEBUG   ] Finished updating board flags in 2.228 seconds
2019-01-17 14:26:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 14:26:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:27:08 [DEBUG   ] Got command RPT from MCS: ref #1197034
2019-01-17 14:27:08 [DEBUG   ] summary = ERROR
2019-01-17 14:27:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197034  13 58500 52028809 A  ERRORERROR'
2019-01-17 14:27:09 [DEBUG   ] Got command RPT from MCS: ref #1197035
2019-01-17 14:27:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197035  77 58500 52029013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:27:09 [DEBUG   ] Got command RPT from MCS: ref #1197036
2019-01-17 14:27:09 [DEBUG   ] summary = ERROR
2019-01-17 14:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197036  13 58500 52029217 A  ERRORERROR'
2019-01-17 14:27:09 [DEBUG   ] Got command RPT from MCS: ref #1197038
2019-01-17 14:27:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197038  77 58500 52029409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:27:09 [DEBUG   ] Got command RPT from MCS: ref #1197039
2019-01-17 14:27:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197039  12 58500 52029613 A  ERRORB•™š'
2019-01-17 14:27:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:27:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:27:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:27:29 [DEBUG   ] Finished updating board flags in 2.195 seconds
2019-01-17 14:27:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:27:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 14:28:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 14:28:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:28:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 14:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:28:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:28:29 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-17 14:28:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 14:28:53 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 14:29:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 14:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:29:29 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-17 14:29:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:29:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:30:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:30:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:30:29 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-17 14:30:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:30:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:31:05 [DEBUG   ] Got command RPT from MCS: ref #1197052
2019-01-17 14:31:05 [DEBUG   ] summary = ERROR
2019-01-17 14:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197052  13 58500 52265661 A  ERRORERROR'
2019-01-17 14:31:05 [DEBUG   ] Got command RPT from MCS: ref #1197053
2019-01-17 14:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197053  77 58500 52265662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:31:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:31:29 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-17 14:31:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 14:31:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:32:08 [DEBUG   ] Got command RPT from MCS: ref #1197069
2019-01-17 14:32:08 [DEBUG   ] summary = ERROR
2019-01-17 14:32:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197069  13 58500 52328897 A  ERRORERROR'
2019-01-17 14:32:09 [DEBUG   ] Got command RPT from MCS: ref #1197070
2019-01-17 14:32:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197070  77 58500 52329101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:32:09 [DEBUG   ] Got command RPT from MCS: ref #1197071
2019-01-17 14:32:09 [DEBUG   ] summary = ERROR
2019-01-17 14:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197071  13 58500 52329305 A  ERRORERROR'
2019-01-17 14:32:09 [DEBUG   ] Got command RPT from MCS: ref #1197072
2019-01-17 14:32:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197072  77 58500 52329497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:32:09 [DEBUG   ] Got command RPT from MCS: ref #1197073
2019-01-17 14:32:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197073  12 58500 52329701 A  ERRORB—™š'
2019-01-17 14:32:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:32:29 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-17 14:32:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:32:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 14:33:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 14:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:33:29 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-17 14:33:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:33:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:34:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 14:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:34:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 14:34:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:34:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:34:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:34:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:34:29 [DEBUG   ] Finished updating board flags in 1.479 seconds
2019-01-17 14:34:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:34:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:35:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:35:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 14:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:35:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:35:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:35:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:35:29 [WARNING ] (13, 1, 'bot')
2019-01-17 14:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:35:29 [DEBUG   ] Finished updating board flags in 1.517 seconds
2019-01-17 14:35:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 14:35:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:36:05 [DEBUG   ] Got command RPT from MCS: ref #1197078
2019-01-17 14:36:05 [DEBUG   ] summary = ERROR
2019-01-17 14:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197078  13 58500 52565669 A  ERRORERROR'
2019-01-17 14:36:05 [DEBUG   ] Got command RPT from MCS: ref #1197079
2019-01-17 14:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197079  77 58500 52565670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:36:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:36:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:36:30 [DEBUG   ] Finished updating board flags in 2.245 seconds
2019-01-17 14:36:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:36:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:37:08 [DEBUG   ] Got command RPT from MCS: ref #1197101
2019-01-17 14:37:08 [DEBUG   ] summary = ERROR
2019-01-17 14:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197101  13 58500 52628989 A  ERRORERROR'
2019-01-17 14:37:09 [DEBUG   ] Got command RPT from MCS: ref #1197102
2019-01-17 14:37:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197102  77 58500 52629181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:37:09 [DEBUG   ] Got command RPT from MCS: ref #1197103
2019-01-17 14:37:09 [DEBUG   ] summary = ERROR
2019-01-17 14:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197103  13 58500 52629385 A  ERRORERROR'
2019-01-17 14:37:09 [DEBUG   ] Got command RPT from MCS: ref #1197105
2019-01-17 14:37:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197105  77 58500 52629589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:37:09 [DEBUG   ] Got command RPT from MCS: ref #1197106
2019-01-17 14:37:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197106  12 58500 52629793 A  ERRORB—™š'
2019-01-17 14:37:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:37:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:37:30 [DEBUG   ] Finished updating board flags in 2.244 seconds
2019-01-17 14:37:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:37:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:38:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:38:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:38:30 [DEBUG   ] Finished updating board flags in 2.124 seconds
2019-01-17 14:38:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:38:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:39:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:39:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:39:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:39:30 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-17 14:39:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 14:39:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 14:40:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 14:40:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:40:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:40:30 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-17 14:40:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 14:40:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:41:05 [DEBUG   ] Got command RPT from MCS: ref #1197115
2019-01-17 14:41:05 [DEBUG   ] summary = ERROR
2019-01-17 14:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197115  13 58500 52865669 A  ERRORERROR'
2019-01-17 14:41:05 [DEBUG   ] Got command RPT from MCS: ref #1197116
2019-01-17 14:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197116  77 58500 52865670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:41:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 14:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:41:30 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-17 14:41:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:41:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 14:42:09 [DEBUG   ] Got command RPT from MCS: ref #1197132
2019-01-17 14:42:09 [DEBUG   ] summary = ERROR
2019-01-17 14:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197132  13 58500 52929077 A  ERRORERROR'
2019-01-17 14:42:09 [DEBUG   ] Got command RPT from MCS: ref #1197133
2019-01-17 14:42:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197133  77 58500 52929269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:42:09 [DEBUG   ] Got command RPT from MCS: ref #1197134
2019-01-17 14:42:09 [DEBUG   ] summary = ERROR
2019-01-17 14:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197134  13 58500 52929473 A  ERRORERROR'
2019-01-17 14:42:09 [DEBUG   ] Got command RPT from MCS: ref #1197135
2019-01-17 14:42:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197135  77 58500 52929677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:42:09 [DEBUG   ] Got command RPT from MCS: ref #1197136
2019-01-17 14:42:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197136  12 58500 52929881 A  ERRORB•™š'
2019-01-17 14:42:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:42:30 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-17 14:42:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 14:42:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:43:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:43:30 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-17 14:43:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:43:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 14:44:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 14:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:44:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:44:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:44:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:44:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:44:30 [DEBUG   ] Finished updating board flags in 1.561 seconds
2019-01-17 14:44:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 14:44:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:45:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:45:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:45:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:45:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:45:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:45:30 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-17 14:45:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:45:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:46:05 [DEBUG   ] Got command RPT from MCS: ref #1197145
2019-01-17 14:46:05 [DEBUG   ] summary = ERROR
2019-01-17 14:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197145  13 58500 53165665 A  ERRORERROR'
2019-01-17 14:46:05 [DEBUG   ] Got command RPT from MCS: ref #1197146
2019-01-17 14:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197146  77 58500 53165666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:46:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:46:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 14:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:46:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:46:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:46:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:46:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:46:30 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-17 14:46:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:46:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 14:47:09 [DEBUG   ] Got command RPT from MCS: ref #1197164
2019-01-17 14:47:09 [DEBUG   ] summary = ERROR
2019-01-17 14:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197164  13 58500 53229153 A  ERRORERROR'
2019-01-17 14:47:09 [DEBUG   ] Got command RPT from MCS: ref #1197165
2019-01-17 14:47:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197165  77 58500 53229357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:47:09 [DEBUG   ] Got command RPT from MCS: ref #1197166
2019-01-17 14:47:09 [DEBUG   ] summary = ERROR
2019-01-17 14:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197166  13 58500 53229561 A  ERRORERROR'
2019-01-17 14:47:09 [DEBUG   ] Got command RPT from MCS: ref #1197168
2019-01-17 14:47:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197168  77 58500 53229765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:47:09 [DEBUG   ] Got command RPT from MCS: ref #1197170
2019-01-17 14:47:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197170  12 58500 53229957 A  ERRORB–™š'
2019-01-17 14:47:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-17 14:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:47:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:47:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:47:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:47:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:47:30 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-01-17 14:47:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 14:47:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 14:48:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 14:48:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 14:48:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:48:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:48:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:48:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:48:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:48:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:48:30 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-17 14:48:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:48:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:49:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 14:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:49:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 14:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-17 14:49:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:49:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:49:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:49:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:49:30 [WARNING ] (25, 5, 'bot')
2019-01-17 14:49:30 [WARNING ] (25, 5, 'bot')
2019-01-17 14:49:30 [WARNING ] (25, 5, 'bot')
2019-01-17 14:49:30 [WARNING ] (25, 5, 'bot')
2019-01-17 14:49:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:49:30 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-17 14:49:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:49:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:50:11 [DEBUG   ] Got command TBW from MCS: ref #1197179
2019-01-17 14:50:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-17 14:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1197179   8 58500 53411890 A  ERROR'
2019-01-17 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-17 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-17 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-17 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-17 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-17 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-17 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-17 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-17 14:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-17 14:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-17 14:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-17 14:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-17 14:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-17 14:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-17 14:50:15 [DEBUG   ] spawn_process: at 2019-01-17 14:50:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-17 14:50:15 [INFO    ] Finished spawning TBW
2019-01-17 14:50:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:50:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:50:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:50:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:50:30 [WARNING ] (13, 1, 'bot')
2019-01-17 14:50:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:50:30 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-17 14:51:05 [DEBUG   ] Got command RPT from MCS: ref #1197182
2019-01-17 14:51:05 [DEBUG   ] summary = ERROR
2019-01-17 14:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197182  13 58500 53465669 A  ERRORERROR'
2019-01-17 14:51:05 [DEBUG   ] Got command RPT from MCS: ref #1197183
2019-01-17 14:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197183  77 58500 53465670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:51:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:51:31 [DEBUG   ] Finished updating board flags in 2.165 seconds
2019-01-17 14:52:03 [INFO    ] __waitForTBW - TBW finished in 108.418 s
2019-01-17 14:52:04 [DEBUG   ] Finished updating ant stats in 0.382 seconds
2019-01-17 14:52:04 [INFO    ] Started antennas statistics background thread
2019-01-17 14:52:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547736726']
2019-01-17 14:52:04 [DEBUG   ] spawn_process: at 2019-01-17 14:52:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547736726']
2019-01-17 14:52:04 [INFO    ] Finished spawning TBN in 0.047 s
2019-01-17 14:52:09 [DEBUG   ] Got command RPT from MCS: ref #1197205
2019-01-17 14:52:09 [DEBUG   ] summary = ERROR
2019-01-17 14:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197205  13 58500 53529249 A  ERRORERROR'
2019-01-17 14:52:09 [DEBUG   ] Got command RPT from MCS: ref #1197206
2019-01-17 14:52:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197206  77 58500 53529441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:52:09 [DEBUG   ] Got command RPT from MCS: ref #1197207
2019-01-17 14:52:09 [DEBUG   ] summary = ERROR
2019-01-17 14:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197207  13 58500 53529645 A  ERRORERROR'
2019-01-17 14:52:09 [DEBUG   ] Got command RPT from MCS: ref #1197208
2019-01-17 14:52:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197208  77 58500 53529849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:52:10 [DEBUG   ] Got command RPT from MCS: ref #1197209
2019-01-17 14:52:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197209  12 58500 53530053 A  ERRORB—™š'
2019-01-17 14:52:25 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2019-01-17 14:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:52:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:52:31 [DEBUG   ] Finished updating board flags in 2.169 seconds
2019-01-17 14:52:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:53:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:53:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:53:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 14:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:53:31 [DEBUG   ] Finished updating board flags in 1.859 seconds
2019-01-17 14:53:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:54:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:54:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 14:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:54:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:54:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:54:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:54:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:54:31 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-17 14:54:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:55:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 14:55:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 14:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:55:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:55:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:55:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:55:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:55:31 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-17 14:55:45 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-17 14:56:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 14:56:05 [DEBUG   ] Got command RPT from MCS: ref #1197217
2019-01-17 14:56:05 [DEBUG   ] summary = ERROR
2019-01-17 14:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197217  13 58500 53765677 A  ERRORERROR'
2019-01-17 14:56:05 [DEBUG   ] Got command RPT from MCS: ref #1197218
2019-01-17 14:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197218  77 58500 53765678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:56:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:56:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:56:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:56:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:56:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:56:31 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-17 14:56:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 14:57:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 14:57:09 [DEBUG   ] Got command RPT from MCS: ref #1197236
2019-01-17 14:57:09 [DEBUG   ] summary = ERROR
2019-01-17 14:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197236  13 58500 53829329 A  ERRORERROR'
2019-01-17 14:57:09 [DEBUG   ] Got command RPT from MCS: ref #1197237
2019-01-17 14:57:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197237  77 58500 53829533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:57:09 [DEBUG   ] Got command RPT from MCS: ref #1197238
2019-01-17 14:57:09 [DEBUG   ] summary = ERROR
2019-01-17 14:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197238  13 58500 53829737 A  ERRORERROR'
2019-01-17 14:57:09 [DEBUG   ] Got command RPT from MCS: ref #1197240
2019-01-17 14:57:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 14:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197240  77 58500 53829929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 14:57:10 [DEBUG   ] Got command RPT from MCS: ref #1197241
2019-01-17 14:57:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 14:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197241  12 58500 53830133 A  ERRORB–™š'
2019-01-17 14:57:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 14:57:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 14:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:57:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:57:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:57:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:57:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:57:31 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-17 14:57:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 14:58:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 14:58:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 14:58:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 14:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:58:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 14:58:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:58:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:58:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:58:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:58:31 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-17 14:58:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:59:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 14:59:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 14:59:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 14:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 14:59:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:59:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:59:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:59:31 [WARNING ] (13, 1, 'bot')
2019-01-17 14:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 14:59:31 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-17 14:59:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 15:00:06 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-17 15:00:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 15:00:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:00:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:00:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:00:31 [WARNING ] (13, 1, 'bot')
2019-01-17 15:00:31 [WARNING ] (13, 1, 'bot')
2019-01-17 15:00:31 [WARNING ] (13, 1, 'bot')
2019-01-17 15:00:31 [WARNING ] (13, 1, 'bot')
2019-01-17 15:00:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:00:31 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-17 15:00:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 15:01:05 [DEBUG   ] Got command RPT from MCS: ref #1197254
2019-01-17 15:01:05 [DEBUG   ] summary = ERROR
2019-01-17 15:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197254  13 58500 54065677 A  ERRORERROR'
2019-01-17 15:01:05 [DEBUG   ] Got command RPT from MCS: ref #1197255
2019-01-17 15:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197255  77 58500 54065678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:01:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 15:01:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 15:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:01:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:01:32 [DEBUG   ] Finished updating board flags in 2.148 seconds
2019-01-17 15:01:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 15:02:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 15:02:09 [DEBUG   ] Got command RPT from MCS: ref #1197271
2019-01-17 15:02:09 [DEBUG   ] summary = ERROR
2019-01-17 15:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197271  13 58500 54129421 A  ERRORERROR'
2019-01-17 15:02:09 [DEBUG   ] Got command RPT from MCS: ref #1197272
2019-01-17 15:02:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197272  77 58500 54129613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:02:09 [DEBUG   ] Got command RPT from MCS: ref #1197273
2019-01-17 15:02:09 [DEBUG   ] summary = ERROR
2019-01-17 15:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197273  13 58500 54129817 A  ERRORERROR'
2019-01-17 15:02:10 [DEBUG   ] Got command RPT from MCS: ref #1197274
2019-01-17 15:02:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197274  77 58500 54130021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:02:10 [DEBUG   ] Got command RPT from MCS: ref #1197275
2019-01-17 15:02:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197275  12 58500 54130225 A  ERRORB—™š'
2019-01-17 15:02:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 15:02:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:02:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:02:32 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-17 15:02:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 15:03:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 15:03:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-17 15:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:03:32 [DEBUG   ] Finished updating board flags in 1.880 seconds
2019-01-17 15:03:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 15:04:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 15:04:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:04:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:04:32 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-17 15:04:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:05:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:05:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:05:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:05:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:05:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:05:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:05:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:05:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:05:32 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-17 15:05:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 15:06:05 [DEBUG   ] Got command RPT from MCS: ref #1197280
2019-01-17 15:06:05 [DEBUG   ] summary = ERROR
2019-01-17 15:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197280  13 58500 54365677 A  ERRORERROR'
2019-01-17 15:06:05 [DEBUG   ] Got command RPT from MCS: ref #1197281
2019-01-17 15:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197281  77 58500 54365678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:06:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 15:06:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:06:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:06:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:06:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:06:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:06:32 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-17 15:06:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 15:07:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 15:07:09 [DEBUG   ] Got command RPT from MCS: ref #1197303
2019-01-17 15:07:09 [DEBUG   ] summary = ERROR
2019-01-17 15:07:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197303  13 58500 54429505 A  ERRORERROR'
2019-01-17 15:07:09 [DEBUG   ] Got command RPT from MCS: ref #1197304
2019-01-17 15:07:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:07:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197304  77 58500 54429697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:07:09 [DEBUG   ] Got command RPT from MCS: ref #1197305
2019-01-17 15:07:09 [DEBUG   ] summary = ERROR
2019-01-17 15:07:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197305  13 58500 54429901 A  ERRORERROR'
2019-01-17 15:07:10 [DEBUG   ] Got command RPT from MCS: ref #1197307
2019-01-17 15:07:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197307  77 58500 54430105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:07:10 [DEBUG   ] Got command RPT from MCS: ref #1197308
2019-01-17 15:07:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197308  12 58500 54430309 A  ERRORB–™š'
2019-01-17 15:07:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 15:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:07:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 15:07:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:07:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:07:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:07:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:07:32 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-17 15:07:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:08:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:08:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 15:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:08:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:08:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:08:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:08:32 [WARNING ] (13, 1, 'bot')
2019-01-17 15:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:08:32 [DEBUG   ] Finished updating board flags in 1.654 seconds
2019-01-17 15:08:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 15:09:00 [DEBUG   ] Got command RPT from MCS: ref #1197313
2019-01-17 15:09:00 [DEBUG   ] summary = ERROR
2019-01-17 15:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197313  13 58500 54540477 A  ERRORERROR'
2019-01-17 15:09:00 [DEBUG   ] Got command RPT from MCS: ref #1197314
2019-01-17 15:09:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197314  77 58500 54540478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:09:05 [DEBUG   ] Got command INI from MCS: ref #1197315
2019-01-17 15:09:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-17 15:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1197315   8 58500 54545485 ABOOTING'
2019-01-17 15:09:06 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-01-17 15:09:29 [INFO    ] -------------------
2019-01-17 15:09:29 [INFO    ]  LWA board status
2019-01-17 15:09:29 [INFO    ] -------------------
2019-01-17 15:09:29 [INFO    ] DP 1: 2 lwa27
2019-01-17 15:09:29 [INFO    ] DP 1: 3 lwa24
2019-01-17 15:09:29 [INFO    ] DP 1: 4 lwa23
2019-01-17 15:09:29 [INFO    ] DP 1: 5 lwa18
2019-01-17 15:09:29 [INFO    ] DP 1: 6 lwa10
2019-01-17 15:09:29 [INFO    ] DP 1: 7 lwa32
2019-01-17 15:09:29 [INFO    ] DP 1: 8 lwa11
2019-01-17 15:09:29 [INFO    ] DP 1: 9 lwa30
2019-01-17 15:09:29 [INFO    ] DP 1: 10 lwa12
2019-01-17 15:09:29 [INFO    ] DP 1: 11 lwa8
2019-01-17 15:09:29 [INFO    ] DP 1: 12 lwa13
2019-01-17 15:09:29 [INFO    ] DP 1: 13 lwa26
2019-01-17 15:09:29 [INFO    ] DP 1: 14 lwa14
2019-01-17 15:09:29 [INFO    ] DP 1: 16 lwa22
2019-01-17 15:09:29 [INFO    ] DP 1: 17 lwa20
2019-01-17 15:09:29 [INFO    ] DP 1: 18 lwa1
2019-01-17 15:09:29 [INFO    ] DP 1: 19 lwa5
2019-01-17 15:09:29 [INFO    ] DP 1: 20 lwa25
2019-01-17 15:09:29 [INFO    ] DP 1: 21 lwa35
2019-01-17 15:09:29 [INFO    ] DP 1: 22 lwa19
2019-01-17 15:09:29 [INFO    ] DP 1: 23 lwa21
2019-01-17 15:09:29 [INFO    ] DP 1: 24 lwa6
2019-01-17 15:09:29 [INFO    ] DP 1: 25 lwa7
2019-01-17 15:09:29 [INFO    ] DP 1: 26 lwa33
2019-01-17 15:09:29 [INFO    ] DP 1: 27 lwa15
2019-01-17 15:09:29 [INFO    ] DP 1: 28 lwa28
2019-01-17 15:09:29 [INFO    ] DP 2: 1 lwa16
2019-01-17 15:09:29 [INFO    ] DP 2: 15 lwa34
2019-01-17 15:09:29 [INFO    ] Total of 28 boards
2019-01-17 15:09:29 [INFO    ] Total of 260 stands
2019-01-17 15:09:29 [INFO    ] -------------------
2019-01-17 15:09:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26903
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26904
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26905
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26906
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26907
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26908
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26909
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26910
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26911
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26912
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26913
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26914
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26915
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26916
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26917
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26918
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26919
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26920
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26921
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26922
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26923
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26924
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26925
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26926
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26927
2019-01-17 15:09:36 [DEBUG   ] 2019-01-17 15:09:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26928
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26903 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26904 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26905 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26906 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26907 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26908 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26909 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26910 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26911 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26912 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26913 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26914 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26915 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26916 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26917 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26918 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26919 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26920 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26921 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26922 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26923 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26924 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26925 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26926 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26927 exited with status 0
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26928 exited with status 0
2019-01-17 15:09:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] spawn_process: at 2019-01-17 15:09:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26955
2019-01-17 15:09:49 [DEBUG   ] 2019-01-17 15:09:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26956
2019-01-17 15:09:54 [DEBUG   ] 2019-01-17 15:09:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26955 exited with status 0
2019-01-17 15:09:54 [DEBUG   ] 2019-01-17 15:09:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26956 exited with status 0
2019-01-17 15:09:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-17 15:09:54 [DEBUG   ] spawn_process: at 2019-01-17 15:09:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-17 15:09:54 [DEBUG   ] spawn_process: at 2019-01-17 15:09:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-17 15:09:54 [INFO    ] Setting Beam 1 xbars
2019-01-17 15:09:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-17 15:09:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-17 15:09:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-17 15:09:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-17 15:09:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-17 15:09:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-17 15:09:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-17 15:09:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-17 15:09:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-17 15:10:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-17 15:10:00 [INFO    ] Setting Beam 2 xbars
2019-01-17 15:10:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-17 15:10:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-17 15:10:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-17 15:10:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-17 15:10:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-17 15:10:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-17 15:10:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-17 15:10:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-17 15:10:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-17 15:10:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-17 15:10:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-17 15:10:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-17 15:10:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-17 15:10:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-17 15:10:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-17 15:10:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-17 15:10:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-17 15:10:05 [INFO    ] Setting Beam 3 xbars
2019-01-17 15:10:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-17 15:10:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-17 15:10:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-17 15:10:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-17 15:10:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-17 15:10:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-17 15:10:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-17 15:10:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-17 15:10:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-17 15:10:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-17 15:10:10 [INFO    ] Setting Beam 4 xbars
2019-01-17 15:10:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-17 15:10:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-17 15:10:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-17 15:10:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-17 15:10:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-17 15:10:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-17 15:10:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-17 15:10:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-17 15:10:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-17 15:10:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-17 15:10:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-17 15:10:16 [INFO    ] All xbars set
2019-01-17 15:10:16 [INFO    ] Setting adder chain routing for all beams
2019-01-17 15:10:21 [INFO    ] Setting beam ids
2019-01-17 15:10:31 [INFO    ] Starting beam delay calibration
2019-01-17 15:10:43 [INFO    ] Beam 1 latency is 5730
2019-01-17 15:10:43 [INFO    ] Beam 2 latency is 5755
2019-01-17 15:10:43 [INFO    ] Beam 3 latency is 5727
2019-01-17 15:10:43 [INFO    ] Beam 4 latency is 6686
2019-01-17 15:10:43 [INFO    ] Stop calibration
2019-01-17 15:10:51 [ERROR   ] Beam delay calibration failed
2019-01-17 15:10:51 [CRITICAL] Calibration failed
2019-01-17 15:10:51 [DEBUG   ] spawn_process: at 2019-01-17 15:10:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-17 15:10:51 [DEBUG   ] spawn_process: at 2019-01-17 15:10:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-17 15:10:51 [DEBUG   ] spawn_process: at 2019-01-17 15:10:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-17 15:10:51 [DEBUG   ] spawn_process: at 2019-01-17 15:10:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-17 15:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-17 15:10:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-17 15:10:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 289 ms (1547737852.291 s) with PID 28550 and time 1547737853
2019-01-17 15:10:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-17 15:10:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 380 ms (1547737852.382 s) with PID 28553 and time 1547737853
2019-01-17 15:10:53 [DEBUG   ] Finished updating ant stats in 0.865 seconds
2019-01-17 15:10:53 [INFO    ] Started antennas statistics background thread
2019-01-17 15:10:53 [INFO    ] Started board flags background thread
2019-01-17 15:10:53 [INFO    ] Started BAM background thread
2019-01-17 15:10:53 [INFO    ] Finished the INI process (ref. #1197315) in 108.020 s
2019-01-17 15:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:10:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:10:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:10:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:10:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:10:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-17 15:10:54 [DEBUG   ] Finished updating board flags in 1.053 seconds
2019-01-17 15:11:05 [DEBUG   ] Got command RPT from MCS: ref #1197320
2019-01-17 15:11:05 [DEBUG   ] summary = ERROR
2019-01-17 15:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197320  13 58500 54665681 A  ERRORERROR'
2019-01-17 15:11:05 [DEBUG   ] Got command RPT from MCS: ref #1197321
2019-01-17 15:11:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197321  98 58500 54665682 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:11:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:11:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:11:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:11:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:11:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:11:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:11:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:11:54 [WARNING ] (13, 1, 'bot')
2019-01-17 15:11:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-17 15:11:54 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-01-17 15:12:05 [DEBUG   ] Got command RPT from MCS: ref #1197337
2019-01-17 15:12:05 [DEBUG   ] summary = ERROR
2019-01-17 15:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197337  13 58500 54725481 A  ERRORERROR'
2019-01-17 15:12:05 [DEBUG   ] Got command RPT from MCS: ref #1197338
2019-01-17 15:12:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197338  98 58500 54725482 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:12:09 [DEBUG   ] Got command RPT from MCS: ref #1197339
2019-01-17 15:12:09 [DEBUG   ] summary = ERROR
2019-01-17 15:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197339  13 58500 54729585 A  ERRORERROR'
2019-01-17 15:12:09 [DEBUG   ] Got command RPT from MCS: ref #1197340
2019-01-17 15:12:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197340  98 58500 54729789 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:12:09 [DEBUG   ] Got command RPT from MCS: ref #1197341
2019-01-17 15:12:09 [DEBUG   ] summary = ERROR
2019-01-17 15:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197341  13 58500 54729993 A  ERRORERROR'
2019-01-17 15:12:10 [DEBUG   ] Got command RPT from MCS: ref #1197342
2019-01-17 15:12:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197342  98 58500 54730185 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:12:10 [DEBUG   ] Got command RPT from MCS: ref #1197343
2019-01-17 15:12:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197343  12 58500 54730389 A  ERRORB•™š'
2019-01-17 15:12:10 [DEBUG   ] Got command INI from MCS: ref #1197344
2019-01-17 15:12:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-17 15:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1197344   8 58500 54730490 ABOOTING'
2019-01-17 15:12:13 [DEBUG   ] Finished updating ant stats in 0.827 seconds
2019-01-17 15:12:31 [INFO    ] -------------------
2019-01-17 15:12:31 [INFO    ]  LWA board status
2019-01-17 15:12:31 [INFO    ] -------------------
2019-01-17 15:12:31 [INFO    ] DP 1: 2 lwa27
2019-01-17 15:12:31 [INFO    ] DP 1: 3 lwa24
2019-01-17 15:12:31 [INFO    ] DP 1: 4 lwa23
2019-01-17 15:12:31 [INFO    ] DP 1: 5 lwa18
2019-01-17 15:12:31 [INFO    ] DP 1: 6 lwa10
2019-01-17 15:12:31 [INFO    ] DP 1: 7 lwa32
2019-01-17 15:12:31 [INFO    ] DP 1: 8 lwa11
2019-01-17 15:12:31 [INFO    ] DP 1: 9 lwa30
2019-01-17 15:12:31 [INFO    ] DP 1: 10 lwa12
2019-01-17 15:12:31 [INFO    ] DP 1: 11 lwa8
2019-01-17 15:12:31 [INFO    ] DP 1: 12 lwa13
2019-01-17 15:12:31 [INFO    ] DP 1: 13 lwa26
2019-01-17 15:12:31 [INFO    ] DP 1: 14 lwa14
2019-01-17 15:12:31 [INFO    ] DP 1: 16 lwa22
2019-01-17 15:12:31 [INFO    ] DP 1: 17 lwa20
2019-01-17 15:12:31 [INFO    ] DP 1: 18 lwa1
2019-01-17 15:12:31 [INFO    ] DP 1: 19 lwa5
2019-01-17 15:12:31 [INFO    ] DP 1: 20 lwa25
2019-01-17 15:12:31 [INFO    ] DP 1: 21 lwa35
2019-01-17 15:12:31 [INFO    ] DP 1: 22 lwa19
2019-01-17 15:12:31 [INFO    ] DP 1: 23 lwa21
2019-01-17 15:12:31 [INFO    ] DP 1: 24 lwa6
2019-01-17 15:12:31 [INFO    ] DP 1: 25 lwa7
2019-01-17 15:12:31 [INFO    ] DP 1: 26 lwa33
2019-01-17 15:12:31 [INFO    ] DP 1: 27 lwa15
2019-01-17 15:12:31 [INFO    ] DP 1: 28 lwa28
2019-01-17 15:12:31 [INFO    ] DP 2: 1 lwa16
2019-01-17 15:12:31 [INFO    ] DP 2: 15 lwa34
2019-01-17 15:12:31 [INFO    ] Total of 28 boards
2019-01-17 15:12:31 [INFO    ] Total of 260 stands
2019-01-17 15:12:31 [INFO    ] -------------------
2019-01-17 15:12:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29104
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29105
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29106
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29107
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29108
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29109
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29110
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29111
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29112
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29113
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29114
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29115
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29116
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29117
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29118
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29119
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29120
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29121
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29122
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29123
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29124
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29125
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29126
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29127
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29128
2019-01-17 15:12:38 [DEBUG   ] 2019-01-17 15:12:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29129
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29104 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29105 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29106 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29107 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29108 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29109 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29110 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29111 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29112 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29113 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29114 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29115 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29116 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29117 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29118 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29119 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29120 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29121 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29122 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29123 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29124 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29125 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29126 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29127 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29128 exited with status 0
2019-01-17 15:12:50 [DEBUG   ] 2019-01-17 15:12:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29129 exited with status 0
2019-01-17 15:12:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:50 [DEBUG   ] spawn_process: at 2019-01-17 15:12:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-17 15:12:51 [DEBUG   ] 2019-01-17 15:12:51 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29156
2019-01-17 15:12:51 [DEBUG   ] 2019-01-17 15:12:51 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29157
2019-01-17 15:12:56 [DEBUG   ] 2019-01-17 15:12:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29156 exited with status 0
2019-01-17 15:12:56 [DEBUG   ] 2019-01-17 15:12:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29157 exited with status 0
2019-01-17 15:12:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-17 15:12:56 [DEBUG   ] spawn_process: at 2019-01-17 15:12:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-17 15:12:56 [DEBUG   ] spawn_process: at 2019-01-17 15:12:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-17 15:12:56 [INFO    ] Setting Beam 1 xbars
2019-01-17 15:12:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-17 15:12:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-17 15:12:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-17 15:12:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-17 15:12:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-17 15:12:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-17 15:12:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-17 15:12:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-17 15:13:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-17 15:13:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-17 15:13:02 [INFO    ] Setting Beam 2 xbars
2019-01-17 15:13:02 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-17 15:13:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-17 15:13:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-17 15:13:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-17 15:13:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-17 15:13:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-17 15:13:07 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-17 15:13:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-17 15:13:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-17 15:13:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-17 15:13:07 [INFO    ] Setting Beam 3 xbars
2019-01-17 15:13:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-17 15:13:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-17 15:13:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-17 15:13:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-17 15:13:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-17 15:13:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-17 15:13:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-17 15:13:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-17 15:13:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-17 15:13:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-17 15:13:12 [INFO    ] Setting Beam 4 xbars
2019-01-17 15:13:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-17 15:13:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-17 15:13:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-17 15:13:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-17 15:13:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-17 15:13:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-17 15:13:18 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-17 15:13:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-17 15:13:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-17 15:13:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-17 15:13:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-17 15:13:18 [INFO    ] All xbars set
2019-01-17 15:13:18 [INFO    ] Setting adder chain routing for all beams
2019-01-17 15:13:23 [INFO    ] Setting beam ids
2019-01-17 15:13:33 [INFO    ] Starting beam delay calibration
2019-01-17 15:13:45 [INFO    ] Beam 1 latency is 5732
2019-01-17 15:13:45 [INFO    ] Beam 2 latency is 6696
2019-01-17 15:13:45 [INFO    ] Beam 3 latency is 6693
2019-01-17 15:13:45 [INFO    ] Beam 4 latency is 5711
2019-01-17 15:13:45 [INFO    ] Stop calibration
2019-01-17 15:13:53 [ERROR   ] Beam delay calibration failed
2019-01-17 15:13:53 [CRITICAL] Calibration failed
2019-01-17 15:13:53 [DEBUG   ] spawn_process: at 2019-01-17 15:13:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-17 15:13:53 [DEBUG   ] spawn_process: at 2019-01-17 15:13:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-17 15:13:53 [DEBUG   ] spawn_process: at 2019-01-17 15:13:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-17 15:13:53 [DEBUG   ] spawn_process: at 2019-01-17 15:13:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-17 15:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-17 15:13:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-17 15:13:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 277 ms (1547738034.279 s) with PID 30736 and time 1547738035
2019-01-17 15:13:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-17 15:13:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 371 ms (1547738034.373 s) with PID 30739 and time 1547738035
2019-01-17 15:13:55 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2019-01-17 15:13:55 [INFO    ] Started antennas statistics background thread
2019-01-17 15:13:55 [INFO    ] Started board flags background thread
2019-01-17 15:13:55 [INFO    ] Started BAM background thread
2019-01-17 15:13:55 [INFO    ] Finished the INI process (ref. #1197344) in 105.005 s
2019-01-17 15:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:13:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:13:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:13:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:13:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:13:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-17 15:13:56 [DEBUG   ] Finished updating board flags in 1.065 seconds
2019-01-17 15:14:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:14:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:14:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:14:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:14:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:14:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:14:56 [WARNING ] (13, 1, 'bot')
2019-01-17 15:14:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-17 15:14:56 [DEBUG   ] Finished updating board flags in 0.985 seconds
2019-01-17 15:15:10 [DEBUG   ] Got command RPT from MCS: ref #1197349
2019-01-17 15:15:10 [DEBUG   ] summary = ERROR
2019-01-17 15:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197349  13 58500 54910489 A  ERRORERROR'
2019-01-17 15:15:10 [DEBUG   ] Got command RPT from MCS: ref #1197350
2019-01-17 15:15:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197350  98 58500 54910490 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:15:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:15:15 [DEBUG   ] Got command INI from MCS: ref #1197351
2019-01-17 15:15:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-17 15:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1197351   8 58500 54915502 ABOOTING'
2019-01-17 15:15:36 [INFO    ] -------------------
2019-01-17 15:15:36 [INFO    ]  LWA board status
2019-01-17 15:15:36 [INFO    ] -------------------
2019-01-17 15:15:36 [INFO    ] DP 1: 2 lwa27
2019-01-17 15:15:36 [INFO    ] DP 1: 3 lwa24
2019-01-17 15:15:36 [INFO    ] DP 1: 4 lwa23
2019-01-17 15:15:36 [INFO    ] DP 1: 5 lwa18
2019-01-17 15:15:36 [INFO    ] DP 1: 6 lwa10
2019-01-17 15:15:36 [INFO    ] DP 1: 7 lwa32
2019-01-17 15:15:36 [INFO    ] DP 1: 8 lwa11
2019-01-17 15:15:36 [INFO    ] DP 1: 9 lwa30
2019-01-17 15:15:36 [INFO    ] DP 1: 10 lwa12
2019-01-17 15:15:36 [INFO    ] DP 1: 11 lwa8
2019-01-17 15:15:36 [INFO    ] DP 1: 12 lwa13
2019-01-17 15:15:36 [INFO    ] DP 1: 13 lwa26
2019-01-17 15:15:36 [INFO    ] DP 1: 14 lwa14
2019-01-17 15:15:36 [INFO    ] DP 1: 16 lwa22
2019-01-17 15:15:36 [INFO    ] DP 1: 17 lwa20
2019-01-17 15:15:36 [INFO    ] DP 1: 18 lwa1
2019-01-17 15:15:36 [INFO    ] DP 1: 19 lwa5
2019-01-17 15:15:36 [INFO    ] DP 1: 20 lwa25
2019-01-17 15:15:36 [INFO    ] DP 1: 21 lwa35
2019-01-17 15:15:36 [INFO    ] DP 1: 22 lwa19
2019-01-17 15:15:36 [INFO    ] DP 1: 23 lwa21
2019-01-17 15:15:36 [INFO    ] DP 1: 24 lwa6
2019-01-17 15:15:36 [INFO    ] DP 1: 25 lwa7
2019-01-17 15:15:36 [INFO    ] DP 1: 26 lwa33
2019-01-17 15:15:36 [INFO    ] DP 1: 27 lwa15
2019-01-17 15:15:36 [INFO    ] DP 1: 28 lwa28
2019-01-17 15:15:36 [INFO    ] DP 2: 1 lwa16
2019-01-17 15:15:36 [INFO    ] DP 2: 15 lwa34
2019-01-17 15:15:36 [INFO    ] Total of 28 boards
2019-01-17 15:15:36 [INFO    ] Total of 260 stands
2019-01-17 15:15:36 [INFO    ] -------------------
2019-01-17 15:15:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31295
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31296
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31297
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31298
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31299
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31300
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31301
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31302
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31303
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31304
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31305
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31306
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31307
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31308
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31309
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31310
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31311
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31312
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31313
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31314
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31315
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31316
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31317
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31318
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31319
2019-01-17 15:15:43 [DEBUG   ] 2019-01-17 15:15:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31320
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31295 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31296 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31297 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31298 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31299 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31300 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31301 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31302 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31303 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31304 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31305 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31306 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31307 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31308 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31309 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31310 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31311 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31312 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31313 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31314 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31315 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31316 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31317 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31318 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31319 exited with status 0
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31320 exited with status 0
2019-01-17 15:15:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] spawn_process: at 2019-01-17 15:15:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31347
2019-01-17 15:15:55 [DEBUG   ] 2019-01-17 15:15:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31348
2019-01-17 15:16:01 [DEBUG   ] 2019-01-17 15:16:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31347 exited with status 0
2019-01-17 15:16:01 [DEBUG   ] 2019-01-17 15:16:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31348 exited with status 0
2019-01-17 15:16:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-17 15:16:01 [DEBUG   ] spawn_process: at 2019-01-17 15:16:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-17 15:16:01 [DEBUG   ] spawn_process: at 2019-01-17 15:16:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-17 15:16:01 [INFO    ] Setting Beam 1 xbars
2019-01-17 15:16:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-17 15:16:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-17 15:16:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-17 15:16:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-17 15:16:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-17 15:16:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-17 15:16:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-17 15:16:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-17 15:16:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-17 15:16:05 [DEBUG   ] Got command RPT from MCS: ref #1197356
2019-01-17 15:16:05 [DEBUG   ] summary = BOOTING
2019-01-17 15:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197356  15 58500 54965682 ABOOTINGBOOTING'
2019-01-17 15:16:05 [DEBUG   ] Got command RPT from MCS: ref #1197357
2019-01-17 15:16:05 [DEBUG   ] info = Starting calibration
2019-01-17 15:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197357  28 58500 54965682 ABOOTINGStarting calibration'
2019-01-17 15:16:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-17 15:16:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-17 15:16:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-17 15:16:06 [INFO    ] Setting Beam 2 xbars
2019-01-17 15:16:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-17 15:16:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-17 15:16:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-17 15:16:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-17 15:16:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-17 15:16:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-17 15:16:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-17 15:16:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-17 15:16:12 [INFO    ] Setting Beam 3 xbars
2019-01-17 15:16:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-17 15:16:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-17 15:16:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-17 15:16:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-17 15:16:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-17 15:16:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-17 15:16:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-17 15:16:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-17 15:16:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-17 15:16:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-17 15:16:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-17 15:16:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-17 15:16:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-17 15:16:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-17 15:16:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-17 15:16:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-17 15:16:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-17 15:16:17 [INFO    ] Setting Beam 4 xbars
2019-01-17 15:16:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-17 15:16:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-17 15:16:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-17 15:16:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-17 15:16:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-17 15:16:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-17 15:16:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-17 15:16:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-17 15:16:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-17 15:16:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-17 15:16:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-17 15:16:23 [INFO    ] All xbars set
2019-01-17 15:16:23 [INFO    ] Setting adder chain routing for all beams
2019-01-17 15:16:28 [INFO    ] Setting beam ids
2019-01-17 15:16:38 [INFO    ] Starting beam delay calibration
2019-01-17 15:16:50 [INFO    ] Beam 1 latency is 5713
2019-01-17 15:16:50 [INFO    ] Beam 2 latency is 5744
2019-01-17 15:16:50 [INFO    ] Beam 3 latency is 5738
2019-01-17 15:16:50 [INFO    ] Beam 4 latency is 5719
2019-01-17 15:16:50 [INFO    ] Stop calibration
2019-01-17 15:16:58 [INFO    ] Beam delay calibration successful
2019-01-17 15:16:58 [INFO    ] Calibration passed
2019-01-17 15:16:58 [DEBUG   ] spawn_process: at 2019-01-17 15:16:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-17 15:16:58 [DEBUG   ] spawn_process: at 2019-01-17 15:16:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-17 15:16:58 [DEBUG   ] spawn_process: at 2019-01-17 15:16:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-17 15:16:58 [DEBUG   ] spawn_process: at 2019-01-17 15:16:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-17 15:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-17 15:16:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-17 15:16:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 496 ms (1547738218.498 s) with PID 440 and time 1547738219
2019-01-17 15:16:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-17 15:16:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 268 ms (1547738219.271 s) with PID 462 and time 1547738220
2019-01-17 15:17:00 [DEBUG   ] Finished updating ant stats in 0.977 seconds
2019-01-17 15:17:00 [INFO    ] Started antennas statistics background thread
2019-01-17 15:17:00 [INFO    ] Started board flags background thread
2019-01-17 15:17:00 [INFO    ] Started BAM background thread
2019-01-17 15:17:00 [INFO    ] Finished the INI process (ref. #1197351) in 104.892 s
2019-01-17 15:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:17:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:17:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:17:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:17:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:17:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:17:01 [DEBUG   ] Finished updating board flags in 1.267 seconds
2019-01-17 15:17:09 [DEBUG   ] Got command RPT from MCS: ref #1197375
2019-01-17 15:17:09 [DEBUG   ] summary = ERROR
2019-01-17 15:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197375  13 58500 55029665 A  ERRORERROR'
2019-01-17 15:17:09 [DEBUG   ] Got command RPT from MCS: ref #1197376
2019-01-17 15:17:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197376  77 58500 55029869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:17:10 [DEBUG   ] Got command RPT from MCS: ref #1197377
2019-01-17 15:17:10 [DEBUG   ] summary = ERROR
2019-01-17 15:17:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197377  13 58500 55030073 A  ERRORERROR'
2019-01-17 15:17:10 [DEBUG   ] Got command RPT from MCS: ref #1197379
2019-01-17 15:17:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:17:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197379  77 58500 55030277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:17:10 [DEBUG   ] Got command RPT from MCS: ref #1197380
2019-01-17 15:17:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:17:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197380  12 58500 55030469 A  ERRORB–™š'
2019-01-17 15:17:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:17:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:18:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:18:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:18:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:18:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:18:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:18:01 [DEBUG   ] Finished updating board flags in 1.097 seconds
2019-01-17 15:18:15 [DEBUG   ] Got command RPT from MCS: ref #1197385
2019-01-17 15:18:15 [DEBUG   ] summary = ERROR
2019-01-17 15:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197385  13 58500 55095493 A  ERRORERROR'
2019-01-17 15:18:15 [DEBUG   ] Got command RPT from MCS: ref #1197386
2019-01-17 15:18:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197386  77 58500 55095494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:18:20 [DEBUG   ] Finished updating ant stats in 0.786 seconds
2019-01-17 15:18:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 15:19:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 15:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:19:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:19:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:19:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:19:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:19:01 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-01-17 15:19:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 15:19:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 15:20:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:20:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:20:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:20:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:20:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:20:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:20:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:20:01 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-01-17 15:20:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 15:20:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:21:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:21:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:21:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:21:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:21:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:21:02 [DEBUG   ] Finished updating board flags in 1.850 seconds
2019-01-17 15:21:05 [DEBUG   ] Got command RPT from MCS: ref #1197391
2019-01-17 15:21:05 [DEBUG   ] summary = ERROR
2019-01-17 15:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197391  13 58500 55265673 A  ERRORERROR'
2019-01-17 15:21:05 [DEBUG   ] Got command RPT from MCS: ref #1197392
2019-01-17 15:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197392  77 58500 55265674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:21:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:21:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 15:22:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:22:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:22:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:22:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:22:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:22:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:22:01 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-01-17 15:22:09 [DEBUG   ] Got command RPT from MCS: ref #1197412
2019-01-17 15:22:09 [DEBUG   ] summary = ERROR
2019-01-17 15:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197412  13 58500 55329757 A  ERRORERROR'
2019-01-17 15:22:09 [DEBUG   ] Got command RPT from MCS: ref #1197413
2019-01-17 15:22:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197413  77 58500 55329961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:22:10 [DEBUG   ] Got command RPT from MCS: ref #1197414
2019-01-17 15:22:10 [DEBUG   ] summary = ERROR
2019-01-17 15:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197414  13 58500 55330153 A  ERRORERROR'
2019-01-17 15:22:10 [DEBUG   ] Got command RPT from MCS: ref #1197415
2019-01-17 15:22:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197415  77 58500 55330357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:22:10 [DEBUG   ] Got command RPT from MCS: ref #1197416
2019-01-17 15:22:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197416  12 58500 55330561 A  ERRORB–™š'
2019-01-17 15:22:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:22:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:23:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:23:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:23:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:23:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:23:01 [WARNING ] (13, 1, 'bot')
2019-01-17 15:23:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:23:01 [DEBUG   ] Finished updating board flags in 1.249 seconds
2019-01-17 15:23:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:23:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:24:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 15:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:24:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:24:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:24:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:24:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:24:02 [DEBUG   ] Finished updating board flags in 1.765 seconds
2019-01-17 15:24:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:24:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:25:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:25:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:25:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:25:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:25:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:25:02 [DEBUG   ] Finished updating board flags in 1.540 seconds
2019-01-17 15:25:20 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2019-01-17 15:25:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 15:26:01 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2019-01-17 15:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:26:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:26:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:26:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:26:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:26:02 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-17 15:26:05 [DEBUG   ] Got command RPT from MCS: ref #1197421
2019-01-17 15:26:05 [DEBUG   ] summary = ERROR
2019-01-17 15:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197421  13 58500 55565673 A  ERRORERROR'
2019-01-17 15:26:05 [DEBUG   ] Got command RPT from MCS: ref #1197422
2019-01-17 15:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197422  77 58500 55565674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:26:21 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2019-01-17 15:26:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 15:27:01 [DEBUG   ] Finished updating ant stats in 1.033 seconds
2019-01-17 15:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:27:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:27:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:27:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:27:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:27:02 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-17 15:27:09 [DEBUG   ] Got command RPT from MCS: ref #1197440
2019-01-17 15:27:09 [DEBUG   ] summary = ERROR
2019-01-17 15:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197440  13 58500 55629841 A  ERRORERROR'
2019-01-17 15:27:10 [DEBUG   ] Got command RPT from MCS: ref #1197441
2019-01-17 15:27:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197441  77 58500 55630045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:27:10 [DEBUG   ] Got command RPT from MCS: ref #1197442
2019-01-17 15:27:10 [DEBUG   ] summary = ERROR
2019-01-17 15:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197442  13 58500 55630249 A  ERRORERROR'
2019-01-17 15:27:10 [DEBUG   ] Got command RPT from MCS: ref #1197444
2019-01-17 15:27:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197444  77 58500 55630441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:27:10 [DEBUG   ] Got command RPT from MCS: ref #1197445
2019-01-17 15:27:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197445  12 58500 55630645 A  ERRORB–™š'
2019-01-17 15:27:21 [DEBUG   ] Finished updating ant stats in 0.971 seconds
2019-01-17 15:27:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:28:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:28:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:28:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:28:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:28:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:28:02 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-01-17 15:28:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:28:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:29:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 15:29:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:29:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:29:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:29:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:29:02 [DEBUG   ] Finished updating board flags in 1.243 seconds
2019-01-17 15:29:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:29:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:29:56 [DEBUG   ] Got command DRX from MCS: ref #1197459
2019-01-17 15:29:56 [INFO    ] sending drx command to lwa16
2019-01-17 15:29:56 [DEBUG   ] run_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2019-01-17 15:29:56 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-17 15:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1197459   8 58500 55796013 A  ERROR'
2019-01-17 15:29:56 [DEBUG   ] Got command DRX from MCS: ref #1197458
2019-01-17 15:29:56 [INFO    ] sending drx command to lwa34
2019-01-17 15:29:56 [DEBUG   ] run_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-01-17 15:29:56 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-17 15:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1197458   8 58500 55796017 A  ERROR'
2019-01-17 15:29:56 [DEBUG   ] Got command DRX from MCS: ref #1197460
2019-01-17 15:29:56 [INFO    ] sending drx command to lwa34
2019-01-17 15:29:56 [DEBUG   ] run_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-01-17 15:29:56 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-17 15:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1197460   8 58500 55796021 A  ERROR'
2019-01-17 15:29:56 [DEBUG   ] Got command DRX from MCS: ref #1197461
2019-01-17 15:29:56 [INFO    ] sending drx command to lwa16
2019-01-17 15:29:56 [DEBUG   ] run_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2019-01-17 15:29:56 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-17 15:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1197461   8 58500 55796025 A  ERROR'
2019-01-17 15:29:56 [DEBUG   ] Got command BAM from MCS: ref #1197463
2019-01-17 15:29:56 [INFO    ] Finished processing BAM request
2019-01-17 15:29:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197463   8 58500 55796029 A  ERROR'
2019-01-17 15:29:56 [DEBUG   ] Got command BAM from MCS: ref #1197462
2019-01-17 15:29:56 [INFO    ] Finished processing BAM request
2019-01-17 15:29:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197462   8 58500 55796033 A  ERROR'
2019-01-17 15:29:56 [INFO    ] Finished starting DRX
2019-01-17 15:29:56 [INFO    ] Finished starting DRX
2019-01-17 15:29:56 [INFO    ] Finished starting DRX
2019-01-17 15:29:56 [INFO    ] Finished starting DRX
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:29:56 [DEBUG   ] spawn_process: at 2019-01-17 15:29:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:30:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:30:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:30:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 15:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:30:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:30:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:30:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:30:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:30:02 [DEBUG   ] Finished updating board flags in 1.154 seconds
2019-01-17 15:30:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:30:40 [DEBUG   ] Got command BAM from MCS: ref #1197470
2019-01-17 15:30:40 [INFO    ] Finished processing BAM request
2019-01-17 15:30:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197470   8 58500 55840029 A  ERROR'
2019-01-17 15:30:40 [DEBUG   ] Got command BAM from MCS: ref #1197471
2019-01-17 15:30:40 [INFO    ] Finished processing BAM request
2019-01-17 15:30:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197471   8 58500 55840033 A  ERROR'
2019-01-17 15:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:30:40 [DEBUG   ] spawn_process: at 2019-01-17 15:30:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:30:41 [DEBUG   ] spawn_process: at 2019-01-17 15:30:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:30:41 [DEBUG   ] spawn_process: at 2019-01-17 15:30:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:30:41 [DEBUG   ] spawn_process: at 2019-01-17 15:30:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:30:41 [DEBUG   ] spawn_process: at 2019-01-17 15:30:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:30:41 [DEBUG   ] spawn_process: at 2019-01-17 15:30:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:30:42 [DEBUG   ] Finished updating ant stats in 1.810 seconds
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:30:42 [DEBUG   ] spawn_process: at 2019-01-17 15:30:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:31:01 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-17 15:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 15:31:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:31:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:31:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:31:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:31:02 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-01-17 15:31:05 [DEBUG   ] Got command RPT from MCS: ref #1197472
2019-01-17 15:31:05 [DEBUG   ] summary = ERROR
2019-01-17 15:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197472  13 58500 55865685 A  ERRORERROR'
2019-01-17 15:31:05 [DEBUG   ] Got command RPT from MCS: ref #1197473
2019-01-17 15:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197473  77 58500 55865686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:31:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 15:31:23 [DEBUG   ] Got command BAM from MCS: ref #1197490
2019-01-17 15:31:23 [INFO    ] Finished processing BAM request
2019-01-17 15:31:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197490   8 58500 55883029 A  ERROR'
2019-01-17 15:31:23 [DEBUG   ] Got command BAM from MCS: ref #1197489
2019-01-17 15:31:23 [INFO    ] Finished processing BAM request
2019-01-17 15:31:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197489   8 58500 55883033 A  ERROR'
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:31:23 [DEBUG   ] spawn_process: at 2019-01-17 15:31:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:31:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 15:32:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 15:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:32:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:32:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:32:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:32:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:32:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:32:02 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-17 15:32:06 [DEBUG   ] Got command BAM from MCS: ref #1197491
2019-01-17 15:32:06 [INFO    ] Finished processing BAM request
2019-01-17 15:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197491   8 58500 55926025 A  ERROR'
2019-01-17 15:32:06 [DEBUG   ] Got command BAM from MCS: ref #1197492
2019-01-17 15:32:06 [INFO    ] Finished processing BAM request
2019-01-17 15:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197492   8 58500 55926029 A  ERROR'
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:32:06 [DEBUG   ] spawn_process: at 2019-01-17 15:32:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:32:09 [DEBUG   ] Got command RPT from MCS: ref #1197493
2019-01-17 15:32:09 [DEBUG   ] summary = ERROR
2019-01-17 15:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197493  13 58500 55929933 A  ERRORERROR'
2019-01-17 15:32:10 [DEBUG   ] Got command RPT from MCS: ref #1197494
2019-01-17 15:32:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197494  77 58500 55930125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:32:10 [DEBUG   ] Got command RPT from MCS: ref #1197495
2019-01-17 15:32:10 [DEBUG   ] summary = ERROR
2019-01-17 15:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197495  13 58500 55930329 A  ERRORERROR'
2019-01-17 15:32:10 [DEBUG   ] Got command RPT from MCS: ref #1197496
2019-01-17 15:32:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197496  77 58500 55930533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:32:10 [DEBUG   ] Got command RPT from MCS: ref #1197497
2019-01-17 15:32:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197497  12 58500 55930725 A  ERRORBŸff'
2019-01-17 15:32:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 15:32:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 15:32:49 [DEBUG   ] Got command BAM from MCS: ref #1197498
2019-01-17 15:32:49 [INFO    ] Finished processing BAM request
2019-01-17 15:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197498   8 58500 55969033 A  ERROR'
2019-01-17 15:32:49 [DEBUG   ] Got command BAM from MCS: ref #1197499
2019-01-17 15:32:49 [INFO    ] Finished processing BAM request
2019-01-17 15:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197499   8 58500 55969037 A  ERROR'
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:32:49 [DEBUG   ] spawn_process: at 2019-01-17 15:32:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:33:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 15:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-17 15:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-17 15:33:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:33:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:33:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:33:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:33:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:33:02 [DEBUG   ] Finished updating board flags in 1.057 seconds
2019-01-17 15:33:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 15:33:32 [DEBUG   ] Got command BAM from MCS: ref #1197504
2019-01-17 15:33:32 [INFO    ] Finished processing BAM request
2019-01-17 15:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197504   8 58500 56012033 A  ERROR'
2019-01-17 15:33:32 [DEBUG   ] Got command BAM from MCS: ref #1197505
2019-01-17 15:33:32 [INFO    ] Finished processing BAM request
2019-01-17 15:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197505   8 58500 56012037 A  ERROR'
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:33:32 [DEBUG   ] spawn_process: at 2019-01-17 15:33:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:33:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:34:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:34:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-01-17 15:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 15:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:34:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 15:34:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:34:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:34:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:34:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:34:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:34:03 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-17 15:34:15 [DEBUG   ] Got command BAM from MCS: ref #1197506
2019-01-17 15:34:15 [INFO    ] Finished processing BAM request
2019-01-17 15:34:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197506   8 58500 56055033 A  ERROR'
2019-01-17 15:34:15 [DEBUG   ] Got command BAM from MCS: ref #1197507
2019-01-17 15:34:15 [INFO    ] Finished processing BAM request
2019-01-17 15:34:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197507   8 58500 56055037 A  ERROR'
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:34:15 [DEBUG   ] spawn_process: at 2019-01-17 15:34:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:34:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:34:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:34:58 [DEBUG   ] Got command BAM from MCS: ref #1197509
2019-01-17 15:34:58 [INFO    ] Finished processing BAM request
2019-01-17 15:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197509   8 58500 56098033 A  ERROR'
2019-01-17 15:34:58 [DEBUG   ] Got command BAM from MCS: ref #1197508
2019-01-17 15:34:58 [INFO    ] Finished processing BAM request
2019-01-17 15:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197508   8 58500 56098037 A  ERROR'
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:34:58 [DEBUG   ] spawn_process: at 2019-01-17 15:34:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:35:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 15:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:35:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:35:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:35:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:35:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:35:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:35:03 [DEBUG   ] Finished updating board flags in 1.966 seconds
2019-01-17 15:35:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:35:41 [DEBUG   ] Got command BAM from MCS: ref #1197510
2019-01-17 15:35:41 [INFO    ] Finished processing BAM request
2019-01-17 15:35:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:35:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197510   8 58500 56141025 A  ERROR'
2019-01-17 15:35:41 [DEBUG   ] Got command BAM from MCS: ref #1197511
2019-01-17 15:35:41 [INFO    ] Finished processing BAM request
2019-01-17 15:35:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:35:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197511   8 58500 56141029 A  ERROR'
2019-01-17 15:35:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:35:41 [DEBUG   ] spawn_process: at 2019-01-17 15:35:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:36:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:36:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:36:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:36:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:36:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:36:02 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-01-17 15:36:05 [DEBUG   ] Got command RPT from MCS: ref #1197512
2019-01-17 15:36:05 [DEBUG   ] summary = ERROR
2019-01-17 15:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197512  13 58500 56165677 A  ERRORERROR'
2019-01-17 15:36:05 [DEBUG   ] Got command RPT from MCS: ref #1197513
2019-01-17 15:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197513  77 58500 56165678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:36:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:36:24 [DEBUG   ] Got command BAM from MCS: ref #1197533
2019-01-17 15:36:24 [INFO    ] Finished processing BAM request
2019-01-17 15:36:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197533   8 58500 56184029 A  ERROR'
2019-01-17 15:36:24 [DEBUG   ] Got command BAM from MCS: ref #1197534
2019-01-17 15:36:24 [INFO    ] Finished processing BAM request
2019-01-17 15:36:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197534   8 58500 56184033 A  ERROR'
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:36:24 [DEBUG   ] spawn_process: at 2019-01-17 15:36:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:36:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:37:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 15:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-17 15:37:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:37:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:37:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:37:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:37:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:37:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:37:02 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-01-17 15:37:07 [DEBUG   ] Got command BAM from MCS: ref #1197537
2019-01-17 15:37:07 [INFO    ] Finished processing BAM request
2019-01-17 15:37:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:37:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197537   8 58500 56227033 A  ERROR'
2019-01-17 15:37:07 [DEBUG   ] Got command BAM from MCS: ref #1197538
2019-01-17 15:37:07 [INFO    ] Finished processing BAM request
2019-01-17 15:37:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:37:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197538   8 58500 56227037 A  ERROR'
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:37:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:37:07 [DEBUG   ] spawn_process: at 2019-01-17 15:37:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:37:10 [DEBUG   ] Got command RPT from MCS: ref #1197539
2019-01-17 15:37:10 [DEBUG   ] summary = ERROR
2019-01-17 15:37:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197539  13 58500 56230013 A  ERRORERROR'
2019-01-17 15:37:10 [DEBUG   ] Got command RPT from MCS: ref #1197540
2019-01-17 15:37:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:37:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197540  77 58500 56230217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:37:10 [DEBUG   ] Got command RPT from MCS: ref #1197541
2019-01-17 15:37:10 [DEBUG   ] summary = ERROR
2019-01-17 15:37:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197541  13 58500 56230409 A  ERRORERROR'
2019-01-17 15:37:10 [DEBUG   ] Got command RPT from MCS: ref #1197543
2019-01-17 15:37:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:37:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197543  77 58500 56230613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:37:10 [DEBUG   ] Got command RPT from MCS: ref #1197545
2019-01-17 15:37:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:37:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197545  12 58500 56230817 A  ERRORB ff'
2019-01-17 15:37:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:37:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:37:50 [DEBUG   ] Got command BAM from MCS: ref #1197550
2019-01-17 15:37:50 [INFO    ] Finished processing BAM request
2019-01-17 15:37:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:37:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197550   8 58500 56270033 A  ERROR'
2019-01-17 15:37:50 [DEBUG   ] Got command BAM from MCS: ref #1197549
2019-01-17 15:37:50 [INFO    ] Finished processing BAM request
2019-01-17 15:37:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:37:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197549   8 58500 56270037 A  ERROR'
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:37:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:37:50 [DEBUG   ] spawn_process: at 2019-01-17 15:37:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:38:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 15:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 15:38:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:38:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:38:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:38:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:38:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:38:02 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-01-17 15:38:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:38:33 [DEBUG   ] Got command BAM from MCS: ref #1197551
2019-01-17 15:38:33 [INFO    ] Finished processing BAM request
2019-01-17 15:38:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197551   8 58500 56313029 A  ERROR'
2019-01-17 15:38:33 [DEBUG   ] Got command BAM from MCS: ref #1197552
2019-01-17 15:38:33 [INFO    ] Finished processing BAM request
2019-01-17 15:38:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197552   8 58500 56313033 A  ERROR'
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 15:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 15:38:33 [DEBUG   ] spawn_process: at 2019-01-17 15:38:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 15:38:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:39:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 15:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:39:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 15:39:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:39:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:39:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:39:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:39:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:39:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:39:02 [DEBUG   ] Finished updating board flags in 1.029 seconds
2019-01-17 15:39:16 [DEBUG   ] Got command BAM from MCS: ref #1197554
2019-01-17 15:39:16 [INFO    ] Finished processing BAM request
2019-01-17 15:39:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197554   8 58500 56356025 A  ERROR'
2019-01-17 15:39:16 [DEBUG   ] Got command BAM from MCS: ref #1197553
2019-01-17 15:39:16 [INFO    ] Finished processing BAM request
2019-01-17 15:39:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197553   8 58500 56356029 A  ERROR'
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:39:16 [DEBUG   ] spawn_process: at 2019-01-17 15:39:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:39:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:39:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 15:39:59 [DEBUG   ] Got command BAM from MCS: ref #1197559
2019-01-17 15:39:59 [INFO    ] Finished processing BAM request
2019-01-17 15:39:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197559   8 58500 56399025 A  ERROR'
2019-01-17 15:39:59 [DEBUG   ] Got command BAM from MCS: ref #1197560
2019-01-17 15:39:59 [INFO    ] Finished processing BAM request
2019-01-17 15:39:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197560   8 58500 56399029 A  ERROR'
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:39:59 [DEBUG   ] spawn_process: at 2019-01-17 15:39:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:40:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 15:40:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 15:40:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:40:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:40:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:40:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:40:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:40:03 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-17 15:40:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 15:40:42 [DEBUG   ] Got command BAM from MCS: ref #1197562
2019-01-17 15:40:42 [INFO    ] Finished processing BAM request
2019-01-17 15:40:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:40:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197562   8 58500 56442033 A  ERROR'
2019-01-17 15:40:42 [DEBUG   ] Got command BAM from MCS: ref #1197561
2019-01-17 15:40:42 [INFO    ] Finished processing BAM request
2019-01-17 15:40:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:40:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197561   8 58500 56442037 A  ERROR'
2019-01-17 15:40:42 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 15:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 15:40:42 [DEBUG   ] spawn_process: at 2019-01-17 15:40:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 15:41:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 15:41:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:41:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:41:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:41:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:41:02 [WARNING ] (13, 1, 'bot')
2019-01-17 15:41:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:41:02 [DEBUG   ] Finished updating board flags in 0.976 seconds
2019-01-17 15:41:05 [DEBUG   ] Got command RPT from MCS: ref #1197563
2019-01-17 15:41:05 [DEBUG   ] summary = ERROR
2019-01-17 15:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197563  13 58500 56465685 A  ERRORERROR'
2019-01-17 15:41:05 [DEBUG   ] Got command RPT from MCS: ref #1197564
2019-01-17 15:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197564  77 58500 56465686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:41:21 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2019-01-17 15:41:25 [DEBUG   ] Got command BAM from MCS: ref #1197580
2019-01-17 15:41:25 [INFO    ] Finished processing BAM request
2019-01-17 15:41:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197580   8 58500 56485025 A  ERROR'
2019-01-17 15:41:25 [DEBUG   ] Got command BAM from MCS: ref #1197581
2019-01-17 15:41:25 [INFO    ] Finished processing BAM request
2019-01-17 15:41:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197581   8 58500 56485029 A  ERROR'
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 15:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 15:41:25 [DEBUG   ] spawn_process: at 2019-01-17 15:41:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 15:41:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 15:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:42:02 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2019-01-17 15:42:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:42:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:42:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:42:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:42:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:42:03 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-17 15:42:08 [DEBUG   ] Got command BAM from MCS: ref #1197583
2019-01-17 15:42:08 [INFO    ] Finished processing BAM request
2019-01-17 15:42:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197583   8 58500 56528025 A  ERROR'
2019-01-17 15:42:08 [DEBUG   ] Got command BAM from MCS: ref #1197582
2019-01-17 15:42:08 [INFO    ] Finished processing BAM request
2019-01-17 15:42:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197582   8 58500 56528029 A  ERROR'
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:42:08 [DEBUG   ] spawn_process: at 2019-01-17 15:42:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:42:10 [DEBUG   ] Got command RPT from MCS: ref #1197584
2019-01-17 15:42:10 [DEBUG   ] summary = ERROR
2019-01-17 15:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197584  13 58500 56530101 A  ERRORERROR'
2019-01-17 15:42:10 [DEBUG   ] Got command RPT from MCS: ref #1197585
2019-01-17 15:42:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197585  77 58500 56530305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:42:10 [DEBUG   ] Got command RPT from MCS: ref #1197586
2019-01-17 15:42:10 [DEBUG   ] summary = ERROR
2019-01-17 15:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197586  13 58500 56530497 A  ERRORERROR'
2019-01-17 15:42:10 [DEBUG   ] Got command RPT from MCS: ref #1197587
2019-01-17 15:42:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197587  77 58500 56530701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:42:10 [DEBUG   ] Got command RPT from MCS: ref #1197588
2019-01-17 15:42:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197588  12 58500 56530909 A  ERRORBŸff'
2019-01-17 15:42:22 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2019-01-17 15:42:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 15:42:51 [DEBUG   ] Got command BAM from MCS: ref #1197594
2019-01-17 15:42:51 [INFO    ] Finished processing BAM request
2019-01-17 15:42:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:42:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197594   8 58500 56571029 A  ERROR'
2019-01-17 15:42:51 [DEBUG   ] Got command BAM from MCS: ref #1197593
2019-01-17 15:42:51 [INFO    ] Finished processing BAM request
2019-01-17 15:42:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:42:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197593   8 58500 56571033 A  ERROR'
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:42:51 [DEBUG   ] spawn_process: at 2019-01-17 15:42:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:43:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 15:43:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:43:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 15:43:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:43:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:43:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:43:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:43:03 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-01-17 15:43:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 15:43:34 [DEBUG   ] Got command BAM from MCS: ref #1197596
2019-01-17 15:43:34 [INFO    ] Finished processing BAM request
2019-01-17 15:43:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197596   8 58500 56614033 A  ERROR'
2019-01-17 15:43:34 [DEBUG   ] Got command BAM from MCS: ref #1197595
2019-01-17 15:43:34 [INFO    ] Finished processing BAM request
2019-01-17 15:43:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197595   8 58500 56614037 A  ERROR'
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:43:34 [DEBUG   ] spawn_process: at 2019-01-17 15:43:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:43:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 15:44:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:44:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:44:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:44:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:44:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:44:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:44:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:44:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:44:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:44:03 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-01-17 15:44:17 [DEBUG   ] Got command BAM from MCS: ref #1197598
2019-01-17 15:44:17 [INFO    ] Finished processing BAM request
2019-01-17 15:44:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197598   8 58500 56657033 A  ERROR'
2019-01-17 15:44:17 [DEBUG   ] Got command BAM from MCS: ref #1197597
2019-01-17 15:44:17 [INFO    ] Finished processing BAM request
2019-01-17 15:44:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197597   8 58500 56657037 A  ERROR'
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:44:17 [DEBUG   ] spawn_process: at 2019-01-17 15:44:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:44:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:44:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:44:59 [DEBUG   ] Got command BAM from MCS: ref #1197599
2019-01-17 15:44:59 [INFO    ] Finished processing BAM request
2019-01-17 15:44:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197599   8 58500 56699025 A  ERROR'
2019-01-17 15:44:59 [DEBUG   ] Got command BAM from MCS: ref #1197600
2019-01-17 15:44:59 [INFO    ] Finished processing BAM request
2019-01-17 15:44:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197600   8 58500 56699029 A  ERROR'
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:44:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:44:59 [DEBUG   ] spawn_process: at 2019-01-17 15:44:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:45:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:45:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:45:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:45:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:45:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:45:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:45:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:45:03 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-17 15:45:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:45:41 [DEBUG   ] Got command BAM from MCS: ref #1197605
2019-01-17 15:45:41 [INFO    ] Finished processing BAM request
2019-01-17 15:45:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:45:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197605   8 58500 56741029 A  ERROR'
2019-01-17 15:45:41 [DEBUG   ] Got command BAM from MCS: ref #1197606
2019-01-17 15:45:41 [INFO    ] Finished processing BAM request
2019-01-17 15:45:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:45:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197606   8 58500 56741033 A  ERROR'
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:45:41 [DEBUG   ] spawn_process: at 2019-01-17 15:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:45:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:46:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:46:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:46:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:46:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 15:46:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:46:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:46:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:46:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:46:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:46:03 [DEBUG   ] Finished updating board flags in 1.033 seconds
2019-01-17 15:46:05 [DEBUG   ] Got command RPT from MCS: ref #1197607
2019-01-17 15:46:05 [DEBUG   ] summary = ERROR
2019-01-17 15:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197607  13 58500 56765681 A  ERRORERROR'
2019-01-17 15:46:05 [DEBUG   ] Got command RPT from MCS: ref #1197608
2019-01-17 15:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197608  77 58500 56765682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:46:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:46:23 [DEBUG   ] Got command BAM from MCS: ref #1197625
2019-01-17 15:46:23 [INFO    ] Finished processing BAM request
2019-01-17 15:46:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197625   8 58500 56783033 A  ERROR'
2019-01-17 15:46:23 [DEBUG   ] Got command BAM from MCS: ref #1197624
2019-01-17 15:46:23 [INFO    ] Finished processing BAM request
2019-01-17 15:46:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197624   8 58500 56783037 A  ERROR'
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 15:46:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 15:46:23 [DEBUG   ] spawn_process: at 2019-01-17 15:46:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 15:46:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:47:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:47:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:47:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:47:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:47:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:47:04 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-17 15:47:05 [DEBUG   ] Got command BAM from MCS: ref #1197628
2019-01-17 15:47:05 [INFO    ] Finished processing BAM request
2019-01-17 15:47:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:47:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197628   8 58500 56825033 A  ERROR'
2019-01-17 15:47:05 [DEBUG   ] Got command BAM from MCS: ref #1197629
2019-01-17 15:47:05 [INFO    ] Finished processing BAM request
2019-01-17 15:47:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:47:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197629   8 58500 56825037 A  ERROR'
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:47:05 [DEBUG   ] spawn_process: at 2019-01-17 15:47:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:47:10 [DEBUG   ] Got command RPT from MCS: ref #1197630
2019-01-17 15:47:10 [DEBUG   ] summary = ERROR
2019-01-17 15:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197630  13 58500 56830185 A  ERRORERROR'
2019-01-17 15:47:10 [DEBUG   ] Got command RPT from MCS: ref #1197631
2019-01-17 15:47:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197631  77 58500 56830389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:47:10 [DEBUG   ] Got command RPT from MCS: ref #1197632
2019-01-17 15:47:10 [DEBUG   ] summary = ERROR
2019-01-17 15:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197632  13 58500 56830593 A  ERRORERROR'
2019-01-17 15:47:10 [DEBUG   ] Got command RPT from MCS: ref #1197634
2019-01-17 15:47:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197634  77 58500 56830785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:47:10 [DEBUG   ] Got command RPT from MCS: ref #1197635
2019-01-17 15:47:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197635  12 58500 56830989 A  ERRORBŸff'
2019-01-17 15:47:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:47:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:47:47 [DEBUG   ] Got command BAM from MCS: ref #1197641
2019-01-17 15:47:47 [INFO    ] Finished processing BAM request
2019-01-17 15:47:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:47:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197641   8 58500 56867029 A  ERROR'
2019-01-17 15:47:47 [DEBUG   ] Got command BAM from MCS: ref #1197640
2019-01-17 15:47:47 [INFO    ] Finished processing BAM request
2019-01-17 15:47:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:47:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197640   8 58500 56867033 A  ERROR'
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:47:47 [DEBUG   ] spawn_process: at 2019-01-17 15:47:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:48:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:48:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 15:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:48:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 15:48:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:48:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:48:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:48:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:48:04 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-17 15:48:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:48:29 [DEBUG   ] Got command BAM from MCS: ref #1197647
2019-01-17 15:48:29 [INFO    ] Finished processing BAM request
2019-01-17 15:48:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197647   8 58500 56909025 A  ERROR'
2019-01-17 15:48:29 [DEBUG   ] Got command BAM from MCS: ref #1197646
2019-01-17 15:48:29 [INFO    ] Finished processing BAM request
2019-01-17 15:48:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197646   8 58500 56909029 A  ERROR'
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:48:29 [DEBUG   ] spawn_process: at 2019-01-17 15:48:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:48:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:49:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:49:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 15:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:49:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:49:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:49:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:49:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:49:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:49:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:49:03 [DEBUG   ] Finished updating board flags in 1.297 seconds
2019-01-17 15:49:11 [DEBUG   ] Got command BAM from MCS: ref #1197649
2019-01-17 15:49:11 [INFO    ] Finished processing BAM request
2019-01-17 15:49:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197649   8 58500 56951025 A  ERROR'
2019-01-17 15:49:11 [DEBUG   ] Got command BAM from MCS: ref #1197648
2019-01-17 15:49:11 [INFO    ] Finished processing BAM request
2019-01-17 15:49:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197648   8 58500 56951029 A  ERROR'
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 15:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 15:49:11 [DEBUG   ] spawn_process: at 2019-01-17 15:49:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 15:49:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:49:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:49:53 [DEBUG   ] Got command BAM from MCS: ref #1197651
2019-01-17 15:49:53 [INFO    ] Finished processing BAM request
2019-01-17 15:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197651   8 58500 56993033 A  ERROR'
2019-01-17 15:49:53 [DEBUG   ] Got command BAM from MCS: ref #1197650
2019-01-17 15:49:53 [INFO    ] Finished processing BAM request
2019-01-17 15:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197650   8 58500 56993037 A  ERROR'
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:49:53 [DEBUG   ] spawn_process: at 2019-01-17 15:49:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:50:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:50:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:50:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 15:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-17 15:50:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:50:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:50:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:50:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:50:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:50:03 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-17 15:50:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:50:35 [DEBUG   ] Got command BAM from MCS: ref #1197653
2019-01-17 15:50:35 [INFO    ] Finished processing BAM request
2019-01-17 15:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197653   8 58500 57035025 A  ERROR'
2019-01-17 15:50:35 [DEBUG   ] Got command BAM from MCS: ref #1197652
2019-01-17 15:50:35 [INFO    ] Finished processing BAM request
2019-01-17 15:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197652   8 58500 57035029 A  ERROR'
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 15:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 15:50:35 [DEBUG   ] spawn_process: at 2019-01-17 15:50:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 15:50:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:51:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:51:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:51:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 15:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-17 15:51:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:51:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:51:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:51:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:51:03 [DEBUG   ] Finished updating board flags in 1.123 seconds
2019-01-17 15:51:05 [DEBUG   ] Got command RPT from MCS: ref #1197654
2019-01-17 15:51:05 [DEBUG   ] summary = ERROR
2019-01-17 15:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197654  13 58500 57065681 A  ERRORERROR'
2019-01-17 15:51:05 [DEBUG   ] Got command RPT from MCS: ref #1197655
2019-01-17 15:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197655  77 58500 57065682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:51:17 [DEBUG   ] Got command BAM from MCS: ref #1197671
2019-01-17 15:51:17 [INFO    ] Finished processing BAM request
2019-01-17 15:51:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:51:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197671   8 58500 57077025 A  ERROR'
2019-01-17 15:51:17 [DEBUG   ] Got command BAM from MCS: ref #1197672
2019-01-17 15:51:17 [INFO    ] Finished processing BAM request
2019-01-17 15:51:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:51:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197672   8 58500 57077029 A  ERROR'
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:51:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:51:17 [DEBUG   ] spawn_process: at 2019-01-17 15:51:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:51:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:51:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:51:59 [DEBUG   ] Got command BAM from MCS: ref #1197678
2019-01-17 15:51:59 [INFO    ] Finished processing BAM request
2019-01-17 15:51:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197678   8 58500 57119033 A  ERROR'
2019-01-17 15:51:59 [DEBUG   ] Got command BAM from MCS: ref #1197677
2019-01-17 15:51:59 [INFO    ] Finished processing BAM request
2019-01-17 15:51:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197677   8 58500 57119037 A  ERROR'
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:51:59 [DEBUG   ] spawn_process: at 2019-01-17 15:51:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:52:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 15:52:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:52:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-17 15:52:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:52:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:52:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:52:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:52:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:52:03 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-17 15:52:10 [DEBUG   ] Got command RPT from MCS: ref #1197679
2019-01-17 15:52:10 [DEBUG   ] summary = ERROR
2019-01-17 15:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197679  13 58500 57130273 A  ERRORERROR'
2019-01-17 15:52:10 [DEBUG   ] Got command RPT from MCS: ref #1197680
2019-01-17 15:52:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197680  77 58500 57130477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:52:10 [DEBUG   ] Got command RPT from MCS: ref #1197681
2019-01-17 15:52:10 [DEBUG   ] summary = ERROR
2019-01-17 15:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197681  13 58500 57130669 A  ERRORERROR'
2019-01-17 15:52:10 [DEBUG   ] Got command RPT from MCS: ref #1197682
2019-01-17 15:52:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197682  77 58500 57130873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:52:11 [DEBUG   ] Got command RPT from MCS: ref #1197683
2019-01-17 15:52:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197683  12 58500 57131077 A  ERRORB¢ff'
2019-01-17 15:52:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:52:41 [DEBUG   ] Got command BAM from MCS: ref #1197684
2019-01-17 15:52:41 [INFO    ] Finished processing BAM request
2019-01-17 15:52:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197684   8 58500 57161025 A  ERROR'
2019-01-17 15:52:41 [DEBUG   ] Got command BAM from MCS: ref #1197685
2019-01-17 15:52:41 [INFO    ] Finished processing BAM request
2019-01-17 15:52:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197685   8 58500 57161029 A  ERROR'
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 15:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 15:52:41 [DEBUG   ] spawn_process: at 2019-01-17 15:52:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 15:52:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:53:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:53:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-17 15:53:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2019-01-17 15:53:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:53:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:53:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:53:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:53:03 [WARNING ] (13, 1, 'bot')
2019-01-17 15:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:53:03 [DEBUG   ] Finished updating board flags in 0.980 seconds
2019-01-17 15:53:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:53:23 [DEBUG   ] Got command BAM from MCS: ref #1197687
2019-01-17 15:53:23 [INFO    ] Finished processing BAM request
2019-01-17 15:53:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197687   8 58500 57203029 A  ERROR'
2019-01-17 15:53:23 [DEBUG   ] Got command BAM from MCS: ref #1197686
2019-01-17 15:53:23 [INFO    ] Finished processing BAM request
2019-01-17 15:53:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197686   8 58500 57203033 A  ERROR'
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:53:23 [DEBUG   ] spawn_process: at 2019-01-17 15:53:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:53:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:54:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:54:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 15:54:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:54:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:54:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:54:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:54:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:54:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:54:04 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-17 15:54:05 [DEBUG   ] Got command BAM from MCS: ref #1197689
2019-01-17 15:54:05 [INFO    ] Finished processing BAM request
2019-01-17 15:54:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197689   8 58500 57245029 A  ERROR'
2019-01-17 15:54:05 [DEBUG   ] Got command BAM from MCS: ref #1197688
2019-01-17 15:54:05 [INFO    ] Finished processing BAM request
2019-01-17 15:54:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197688   8 58500 57245033 A  ERROR'
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:54:05 [DEBUG   ] spawn_process: at 2019-01-17 15:54:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:54:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:54:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:54:47 [DEBUG   ] Got command BAM from MCS: ref #1197695
2019-01-17 15:54:47 [INFO    ] Finished processing BAM request
2019-01-17 15:54:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197695   8 58500 57287025 A  ERROR'
2019-01-17 15:54:47 [DEBUG   ] Got command BAM from MCS: ref #1197694
2019-01-17 15:54:47 [INFO    ] Finished processing BAM request
2019-01-17 15:54:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197694   8 58500 57287029 A  ERROR'
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:54:47 [DEBUG   ] spawn_process: at 2019-01-17 15:54:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:55:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:55:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-17 15:55:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-17 15:55:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:55:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:55:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:55:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:55:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:55:04 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-01-17 15:55:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:55:29 [DEBUG   ] Got command BAM from MCS: ref #1197697
2019-01-17 15:55:29 [INFO    ] Finished processing BAM request
2019-01-17 15:55:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197697   8 58500 57329025 A  ERROR'
2019-01-17 15:55:29 [DEBUG   ] Got command BAM from MCS: ref #1197696
2019-01-17 15:55:29 [INFO    ] Finished processing BAM request
2019-01-17 15:55:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197696   8 58500 57329029 A  ERROR'
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:55:29 [DEBUG   ] spawn_process: at 2019-01-17 15:55:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:55:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:56:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 15:56:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 15:56:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 15:56:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:56:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:56:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:56:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:56:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:56:04 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-17 15:56:05 [DEBUG   ] Got command RPT from MCS: ref #1197698
2019-01-17 15:56:05 [DEBUG   ] summary = ERROR
2019-01-17 15:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197698  13 58500 57365681 A  ERRORERROR'
2019-01-17 15:56:05 [DEBUG   ] Got command RPT from MCS: ref #1197699
2019-01-17 15:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197699  77 58500 57365682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:56:11 [DEBUG   ] Got command BAM from MCS: ref #1197715
2019-01-17 15:56:11 [INFO    ] Finished processing BAM request
2019-01-17 15:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197715   8 58500 57371025 A  ERROR'
2019-01-17 15:56:11 [DEBUG   ] Got command BAM from MCS: ref #1197716
2019-01-17 15:56:11 [INFO    ] Finished processing BAM request
2019-01-17 15:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197716   8 58500 57371029 A  ERROR'
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:56:11 [DEBUG   ] spawn_process: at 2019-01-17 15:56:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:56:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:56:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:56:53 [DEBUG   ] Got command BAM from MCS: ref #1197717
2019-01-17 15:56:53 [INFO    ] Finished processing BAM request
2019-01-17 15:56:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197717   8 58500 57413033 A  ERROR'
2019-01-17 15:56:53 [DEBUG   ] Got command BAM from MCS: ref #1197718
2019-01-17 15:56:53 [INFO    ] Finished processing BAM request
2019-01-17 15:56:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197718   8 58500 57413037 A  ERROR'
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:56:53 [DEBUG   ] spawn_process: at 2019-01-17 15:56:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:57:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:57:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:57:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:57:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:57:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:57:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:57:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:57:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:57:04 [DEBUG   ] Finished updating board flags in 1.050 seconds
2019-01-17 15:57:10 [DEBUG   ] Got command RPT from MCS: ref #1197721
2019-01-17 15:57:10 [DEBUG   ] summary = ERROR
2019-01-17 15:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197721  13 58500 57430353 A  ERRORERROR'
2019-01-17 15:57:10 [DEBUG   ] Got command RPT from MCS: ref #1197722
2019-01-17 15:57:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197722  77 58500 57430557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:57:10 [DEBUG   ] Got command RPT from MCS: ref #1197723
2019-01-17 15:57:10 [DEBUG   ] summary = ERROR
2019-01-17 15:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197723  13 58500 57430761 A  ERRORERROR'
2019-01-17 15:57:10 [DEBUG   ] Got command RPT from MCS: ref #1197725
2019-01-17 15:57:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 15:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197725  77 58500 57430965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 15:57:11 [DEBUG   ] Got command RPT from MCS: ref #1197726
2019-01-17 15:57:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 15:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197726  12 58500 57431157 A  ERRORB ff'
2019-01-17 15:57:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:57:35 [DEBUG   ] Got command BAM from MCS: ref #1197735
2019-01-17 15:57:35 [INFO    ] Finished processing BAM request
2019-01-17 15:57:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197735   8 58500 57455033 A  ERROR'
2019-01-17 15:57:35 [DEBUG   ] Got command BAM from MCS: ref #1197736
2019-01-17 15:57:35 [INFO    ] Finished processing BAM request
2019-01-17 15:57:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197736   8 58500 57455037 A  ERROR'
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:57:35 [DEBUG   ] spawn_process: at 2019-01-17 15:57:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:57:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:58:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 15:58:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:58:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 15:58:05 [WARNING ] (13, 1, 'bot')
2019-01-17 15:58:05 [WARNING ] (13, 1, 'bot')
2019-01-17 15:58:05 [WARNING ] (13, 1, 'bot')
2019-01-17 15:58:05 [WARNING ] (13, 1, 'bot')
2019-01-17 15:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:58:05 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-17 15:58:17 [DEBUG   ] Got command BAM from MCS: ref #1197738
2019-01-17 15:58:17 [INFO    ] Finished processing BAM request
2019-01-17 15:58:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197738   8 58500 57497033 A  ERROR'
2019-01-17 15:58:17 [DEBUG   ] Got command BAM from MCS: ref #1197737
2019-01-17 15:58:17 [INFO    ] Finished processing BAM request
2019-01-17 15:58:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197737   8 58500 57497037 A  ERROR'
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 15:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 15:58:17 [DEBUG   ] spawn_process: at 2019-01-17 15:58:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 15:58:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:58:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:58:59 [DEBUG   ] Got command BAM from MCS: ref #1197739
2019-01-17 15:58:59 [INFO    ] Finished processing BAM request
2019-01-17 15:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197739   8 58500 57539030 A  ERROR'
2019-01-17 15:58:59 [DEBUG   ] Got command BAM from MCS: ref #1197740
2019-01-17 15:58:59 [INFO    ] Finished processing BAM request
2019-01-17 15:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197740   8 58500 57539034 A  ERROR'
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 15:58:59 [DEBUG   ] spawn_process: at 2019-01-17 15:58:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 15:59:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:59:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 15:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 15:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 15:59:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 15:59:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:59:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:59:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:59:04 [WARNING ] (13, 1, 'bot')
2019-01-17 15:59:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 15:59:04 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-17 15:59:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 15:59:41 [DEBUG   ] Got command BAM from MCS: ref #1197742
2019-01-17 15:59:41 [INFO    ] Finished processing BAM request
2019-01-17 15:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197742   8 58500 57581026 A  ERROR'
2019-01-17 15:59:41 [DEBUG   ] Got command BAM from MCS: ref #1197741
2019-01-17 15:59:41 [INFO    ] Finished processing BAM request
2019-01-17 15:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 15:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197741   8 58500 57581030 A  ERROR'
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 15:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 15:59:41 [DEBUG   ] spawn_process: at 2019-01-17 15:59:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 15:59:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 16:00:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 16:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 16:00:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:00:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:00:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:00:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:00:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:00:04 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-17 16:00:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:00:23 [DEBUG   ] Got command BAM from MCS: ref #1197748
2019-01-17 16:00:23 [INFO    ] Finished processing BAM request
2019-01-17 16:00:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197748   8 58500 57623033 A  ERROR'
2019-01-17 16:00:23 [DEBUG   ] Got command BAM from MCS: ref #1197747
2019-01-17 16:00:23 [INFO    ] Finished processing BAM request
2019-01-17 16:00:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197747   8 58500 57623037 A  ERROR'
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:00:23 [DEBUG   ] spawn_process: at 2019-01-17 16:00:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:00:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:01:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-01-17 16:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 16:01:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:01:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:01:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:01:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:01:04 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-01-17 16:01:05 [DEBUG   ] Got command BAM from MCS: ref #1197750
2019-01-17 16:01:05 [INFO    ] Finished processing BAM request
2019-01-17 16:01:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197750   8 58500 57665033 A  ERROR'
2019-01-17 16:01:05 [DEBUG   ] Got command BAM from MCS: ref #1197749
2019-01-17 16:01:05 [INFO    ] Finished processing BAM request
2019-01-17 16:01:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197749   8 58500 57665037 A  ERROR'
2019-01-17 16:01:05 [DEBUG   ] Got command RPT from MCS: ref #1197751
2019-01-17 16:01:05 [DEBUG   ] summary = ERROR
2019-01-17 16:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197751  13 58500 57665685 A  ERRORERROR'
2019-01-17 16:01:05 [DEBUG   ] Got command RPT from MCS: ref #1197752
2019-01-17 16:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197752  77 58500 57665686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:01:05 [DEBUG   ] spawn_process: at 2019-01-17 16:01:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:01:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:01:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:01:47 [DEBUG   ] Got command BAM from MCS: ref #1197769
2019-01-17 16:01:47 [INFO    ] Finished processing BAM request
2019-01-17 16:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197769   8 58500 57707033 A  ERROR'
2019-01-17 16:01:47 [DEBUG   ] Got command BAM from MCS: ref #1197768
2019-01-17 16:01:47 [INFO    ] Finished processing BAM request
2019-01-17 16:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197768   8 58500 57707037 A  ERROR'
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:01:47 [DEBUG   ] spawn_process: at 2019-01-17 16:01:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:02:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 16:02:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:02:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:02:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:02:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:02:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:02:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:02:04 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-01-17 16:02:10 [DEBUG   ] Got command RPT from MCS: ref #1197770
2019-01-17 16:02:10 [DEBUG   ] summary = ERROR
2019-01-17 16:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197770  13 58500 57730437 A  ERRORERROR'
2019-01-17 16:02:10 [DEBUG   ] Got command RPT from MCS: ref #1197771
2019-01-17 16:02:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197771  77 58500 57730641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:02:10 [DEBUG   ] Got command RPT from MCS: ref #1197772
2019-01-17 16:02:10 [DEBUG   ] summary = ERROR
2019-01-17 16:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197772  13 58500 57730845 A  ERRORERROR'
2019-01-17 16:02:11 [DEBUG   ] Got command RPT from MCS: ref #1197773
2019-01-17 16:02:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197773  77 58500 57731049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:02:11 [DEBUG   ] Got command RPT from MCS: ref #1197774
2019-01-17 16:02:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197774  12 58500 57731241 A  ERRORB ff'
2019-01-17 16:02:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:02:29 [DEBUG   ] Got command BAM from MCS: ref #1197776
2019-01-17 16:02:29 [INFO    ] Finished processing BAM request
2019-01-17 16:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197776   8 58500 57749025 A  ERROR'
2019-01-17 16:02:29 [DEBUG   ] Got command BAM from MCS: ref #1197775
2019-01-17 16:02:29 [INFO    ] Finished processing BAM request
2019-01-17 16:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197775   8 58500 57749029 A  ERROR'
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:02:29 [DEBUG   ] spawn_process: at 2019-01-17 16:02:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:02:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:03:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:03:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:03:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:03:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:03:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:03:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:03:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:03:04 [WARNING ] (13, 1, 'bot')
2019-01-17 16:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:03:04 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-17 16:03:11 [DEBUG   ] Got command BAM from MCS: ref #1197777
2019-01-17 16:03:11 [INFO    ] Finished processing BAM request
2019-01-17 16:03:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197777   8 58500 57791025 A  ERROR'
2019-01-17 16:03:11 [DEBUG   ] Got command BAM from MCS: ref #1197778
2019-01-17 16:03:11 [INFO    ] Finished processing BAM request
2019-01-17 16:03:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197778   8 58500 57791029 A  ERROR'
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:03:11 [DEBUG   ] spawn_process: at 2019-01-17 16:03:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:03:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:03:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:03:53 [DEBUG   ] Got command BAM from MCS: ref #1197784
2019-01-17 16:03:53 [INFO    ] Finished processing BAM request
2019-01-17 16:03:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197784   8 58500 57833033 A  ERROR'
2019-01-17 16:03:53 [DEBUG   ] Got command BAM from MCS: ref #1197783
2019-01-17 16:03:53 [INFO    ] Finished processing BAM request
2019-01-17 16:03:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197783   8 58500 57833037 A  ERROR'
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:03:53 [DEBUG   ] spawn_process: at 2019-01-17 16:03:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:04:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:04:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:04:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:04:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:04:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:04:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:04:05 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-01-17 16:04:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:04:35 [DEBUG   ] Got command BAM from MCS: ref #1197786
2019-01-17 16:04:35 [INFO    ] Finished processing BAM request
2019-01-17 16:04:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197786   8 58500 57875029 A  ERROR'
2019-01-17 16:04:35 [DEBUG   ] Got command BAM from MCS: ref #1197785
2019-01-17 16:04:35 [INFO    ] Finished processing BAM request
2019-01-17 16:04:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197785   8 58500 57875033 A  ERROR'
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:04:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:04:35 [DEBUG   ] spawn_process: at 2019-01-17 16:04:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:04:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:05:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:05:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:05:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:05:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:05:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:05:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:05:05 [DEBUG   ] Finished updating board flags in 1.154 seconds
2019-01-17 16:05:17 [DEBUG   ] Got command BAM from MCS: ref #1197787
2019-01-17 16:05:17 [INFO    ] Finished processing BAM request
2019-01-17 16:05:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197787   8 58500 57917033 A  ERROR'
2019-01-17 16:05:17 [DEBUG   ] Got command BAM from MCS: ref #1197788
2019-01-17 16:05:17 [INFO    ] Finished processing BAM request
2019-01-17 16:05:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197788   8 58500 57917037 A  ERROR'
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:05:17 [DEBUG   ] spawn_process: at 2019-01-17 16:05:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:05:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:05:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:05:58 [DEBUG   ] Got command BAM from MCS: ref #1197790
2019-01-17 16:05:58 [INFO    ] Finished processing BAM request
2019-01-17 16:05:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197790   8 58500 57958033 A  ERROR'
2019-01-17 16:05:58 [DEBUG   ] Got command BAM from MCS: ref #1197789
2019-01-17 16:05:58 [INFO    ] Finished processing BAM request
2019-01-17 16:05:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197789   8 58500 57958037 A  ERROR'
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:05:58 [DEBUG   ] spawn_process: at 2019-01-17 16:05:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:06:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 16:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 16:06:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:06:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:06:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:06:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:06:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:06:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:06:05 [DEBUG   ] Finished updating board flags in 1.140 seconds
2019-01-17 16:06:05 [DEBUG   ] Got command RPT from MCS: ref #1197791
2019-01-17 16:06:05 [DEBUG   ] summary = ERROR
2019-01-17 16:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197791  13 58500 57965689 A  ERRORERROR'
2019-01-17 16:06:05 [DEBUG   ] Got command RPT from MCS: ref #1197792
2019-01-17 16:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197792  77 58500 57965690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:06:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:06:39 [DEBUG   ] Got command BAM from MCS: ref #1197813
2019-01-17 16:06:39 [INFO    ] Finished processing BAM request
2019-01-17 16:06:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197813   8 58500 57999029 A  ERROR'
2019-01-17 16:06:39 [DEBUG   ] Got command BAM from MCS: ref #1197812
2019-01-17 16:06:39 [INFO    ] Finished processing BAM request
2019-01-17 16:06:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197812   8 58500 57999033 A  ERROR'
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:06:39 [DEBUG   ] spawn_process: at 2019-01-17 16:06:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:06:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:07:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:07:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:07:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:07:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:07:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:07:06 [DEBUG   ] Finished updating board flags in 1.887 seconds
2019-01-17 16:07:10 [DEBUG   ] Got command RPT from MCS: ref #1197816
2019-01-17 16:07:10 [DEBUG   ] summary = ERROR
2019-01-17 16:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197816  13 58500 58030533 A  ERRORERROR'
2019-01-17 16:07:10 [DEBUG   ] Got command RPT from MCS: ref #1197817
2019-01-17 16:07:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197817  77 58500 58030725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:07:10 [DEBUG   ] Got command RPT from MCS: ref #1197818
2019-01-17 16:07:10 [DEBUG   ] summary = ERROR
2019-01-17 16:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197818  13 58500 58030929 A  ERRORERROR'
2019-01-17 16:07:11 [DEBUG   ] Got command RPT from MCS: ref #1197820
2019-01-17 16:07:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197820  77 58500 58031133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:07:11 [DEBUG   ] Got command RPT from MCS: ref #1197821
2019-01-17 16:07:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197821  12 58500 58031337 A  ERRORBŸff'
2019-01-17 16:07:20 [DEBUG   ] Got command BAM from MCS: ref #1197826
2019-01-17 16:07:20 [INFO    ] Finished processing BAM request
2019-01-17 16:07:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197826   8 58500 58040033 A  ERROR'
2019-01-17 16:07:20 [DEBUG   ] Got command BAM from MCS: ref #1197827
2019-01-17 16:07:20 [INFO    ] Finished processing BAM request
2019-01-17 16:07:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197827   8 58500 58040037 A  ERROR'
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:07:20 [DEBUG   ] spawn_process: at 2019-01-17 16:07:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:07:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:07:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:08:01 [DEBUG   ] Got command BAM from MCS: ref #1197829
2019-01-17 16:08:01 [INFO    ] Finished processing BAM request
2019-01-17 16:08:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197829   8 58500 58081025 A  ERROR'
2019-01-17 16:08:01 [DEBUG   ] Got command BAM from MCS: ref #1197828
2019-01-17 16:08:01 [INFO    ] Finished processing BAM request
2019-01-17 16:08:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197828   8 58500 58081029 A  ERROR'
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:08:01 [DEBUG   ] spawn_process: at 2019-01-17 16:08:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:08:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:08:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:08:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:08:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:08:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:08:06 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-01-17 16:08:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:08:42 [DEBUG   ] Got command BAM from MCS: ref #1197830
2019-01-17 16:08:42 [INFO    ] Finished processing BAM request
2019-01-17 16:08:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197830   8 58500 58122037 A  ERROR'
2019-01-17 16:08:42 [DEBUG   ] Got command BAM from MCS: ref #1197831
2019-01-17 16:08:42 [INFO    ] Finished processing BAM request
2019-01-17 16:08:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197831   8 58500 58122045 A  ERROR'
2019-01-17 16:08:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:08:42 [DEBUG   ] spawn_process: at 2019-01-17 16:08:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:09:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:09:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:09:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:09:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:09:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:09:05 [DEBUG   ] Finished updating board flags in 1.073 seconds
2019-01-17 16:09:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:09:23 [DEBUG   ] Got command BAM from MCS: ref #1197837
2019-01-17 16:09:23 [INFO    ] Finished processing BAM request
2019-01-17 16:09:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197837   8 58500 58163033 A  ERROR'
2019-01-17 16:09:23 [DEBUG   ] Got command BAM from MCS: ref #1197836
2019-01-17 16:09:23 [INFO    ] Finished processing BAM request
2019-01-17 16:09:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197836   8 58500 58163037 A  ERROR'
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:09:23 [DEBUG   ] spawn_process: at 2019-01-17 16:09:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:09:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:10:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:10:04 [DEBUG   ] Got command BAM from MCS: ref #1197839
2019-01-17 16:10:04 [INFO    ] Finished processing BAM request
2019-01-17 16:10:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197839   8 58500 58204025 A  ERROR'
2019-01-17 16:10:04 [DEBUG   ] Got command BAM from MCS: ref #1197838
2019-01-17 16:10:04 [INFO    ] Finished processing BAM request
2019-01-17 16:10:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197838   8 58500 58204029 A  ERROR'
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:10:04 [DEBUG   ] spawn_process: at 2019-01-17 16:10:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:10:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:10:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:10:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:10:05 [WARNING ] (13, 1, 'bot')
2019-01-17 16:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:10:05 [DEBUG   ] Finished updating board flags in 0.967 seconds
2019-01-17 16:10:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:10:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:10:45 [DEBUG   ] Got command BAM from MCS: ref #1197840
2019-01-17 16:10:45 [INFO    ] Finished processing BAM request
2019-01-17 16:10:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197840   8 58500 58245025 A  ERROR'
2019-01-17 16:10:45 [DEBUG   ] Got command BAM from MCS: ref #1197841
2019-01-17 16:10:45 [INFO    ] Finished processing BAM request
2019-01-17 16:10:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197841   8 58500 58245029 A  ERROR'
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:10:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:10:45 [DEBUG   ] spawn_process: at 2019-01-17 16:10:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:11:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:11:05 [DEBUG   ] Got command RPT from MCS: ref #1197842
2019-01-17 16:11:05 [DEBUG   ] summary = ERROR
2019-01-17 16:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197842  13 58500 58265689 A  ERRORERROR'
2019-01-17 16:11:05 [DEBUG   ] Got command RPT from MCS: ref #1197843
2019-01-17 16:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197843  77 58500 58265690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:11:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:11:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:11:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:11:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:11:06 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-17 16:11:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 16:11:26 [DEBUG   ] Got command BAM from MCS: ref #1197859
2019-01-17 16:11:26 [INFO    ] Finished processing BAM request
2019-01-17 16:11:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197859   8 58500 58286029 A  ERROR'
2019-01-17 16:11:26 [DEBUG   ] Got command BAM from MCS: ref #1197860
2019-01-17 16:11:26 [INFO    ] Finished processing BAM request
2019-01-17 16:11:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197860   8 58500 58286033 A  ERROR'
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:11:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:11:26 [DEBUG   ] spawn_process: at 2019-01-17 16:11:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:11:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:12:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 16:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 16:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:12:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:12:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:12:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:12:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:12:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:12:06 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-17 16:12:07 [DEBUG   ] Got command BAM from MCS: ref #1197862
2019-01-17 16:12:07 [INFO    ] Finished processing BAM request
2019-01-17 16:12:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:12:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197862   8 58500 58327033 A  ERROR'
2019-01-17 16:12:07 [DEBUG   ] Got command BAM from MCS: ref #1197861
2019-01-17 16:12:07 [INFO    ] Finished processing BAM request
2019-01-17 16:12:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:12:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197861   8 58500 58327037 A  ERROR'
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:12:07 [DEBUG   ] spawn_process: at 2019-01-17 16:12:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:12:10 [DEBUG   ] Got command RPT from MCS: ref #1197863
2019-01-17 16:12:10 [DEBUG   ] summary = ERROR
2019-01-17 16:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197863  13 58500 58330613 A  ERRORERROR'
2019-01-17 16:12:10 [DEBUG   ] Got command RPT from MCS: ref #1197864
2019-01-17 16:12:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197864  77 58500 58330817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:12:11 [DEBUG   ] Got command RPT from MCS: ref #1197865
2019-01-17 16:12:11 [DEBUG   ] summary = ERROR
2019-01-17 16:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197865  13 58500 58331009 A  ERRORERROR'
2019-01-17 16:12:11 [DEBUG   ] Got command RPT from MCS: ref #1197866
2019-01-17 16:12:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197866  77 58500 58331213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:12:11 [DEBUG   ] Got command RPT from MCS: ref #1197867
2019-01-17 16:12:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197867  12 58500 58331417 A  ERRORB ff'
2019-01-17 16:12:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:12:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:12:48 [DEBUG   ] Got command BAM from MCS: ref #1197872
2019-01-17 16:12:48 [INFO    ] Finished processing BAM request
2019-01-17 16:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197872   8 58500 58368033 A  ERROR'
2019-01-17 16:12:48 [DEBUG   ] Got command BAM from MCS: ref #1197873
2019-01-17 16:12:48 [INFO    ] Finished processing BAM request
2019-01-17 16:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197873   8 58500 58368037 A  ERROR'
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:12:48 [DEBUG   ] spawn_process: at 2019-01-17 16:12:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:13:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:13:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:13:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:13:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:13:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:13:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:13:06 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-17 16:13:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:13:29 [DEBUG   ] Got command BAM from MCS: ref #1197874
2019-01-17 16:13:29 [INFO    ] Finished processing BAM request
2019-01-17 16:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197874   8 58500 58409033 A  ERROR'
2019-01-17 16:13:29 [DEBUG   ] Got command BAM from MCS: ref #1197875
2019-01-17 16:13:29 [INFO    ] Finished processing BAM request
2019-01-17 16:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197875   8 58500 58409037 A  ERROR'
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:13:29 [DEBUG   ] spawn_process: at 2019-01-17 16:13:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:13:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:14:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:14:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-17 16:14:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-17 16:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:14:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:14:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:14:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:14:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:14:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:14:06 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-17 16:14:10 [DEBUG   ] Got command BAM from MCS: ref #1197877
2019-01-17 16:14:10 [INFO    ] Finished processing BAM request
2019-01-17 16:14:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197877   8 58500 58450029 A  ERROR'
2019-01-17 16:14:10 [DEBUG   ] Got command BAM from MCS: ref #1197876
2019-01-17 16:14:10 [INFO    ] Finished processing BAM request
2019-01-17 16:14:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197876   8 58500 58450033 A  ERROR'
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:14:10 [DEBUG   ] spawn_process: at 2019-01-17 16:14:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:14:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:14:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:14:51 [DEBUG   ] Got command BAM from MCS: ref #1197879
2019-01-17 16:14:51 [INFO    ] Finished processing BAM request
2019-01-17 16:14:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197879   8 58500 58491033 A  ERROR'
2019-01-17 16:14:51 [DEBUG   ] Got command BAM from MCS: ref #1197878
2019-01-17 16:14:51 [INFO    ] Finished processing BAM request
2019-01-17 16:14:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197878   8 58500 58491037 A  ERROR'
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:14:51 [DEBUG   ] spawn_process: at 2019-01-17 16:14:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:15:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:15:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 16:15:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:15:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 16:15:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:15:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:15:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:15:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:15:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:15:06 [DEBUG   ] Finished updating board flags in 1.180 seconds
2019-01-17 16:15:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:15:32 [DEBUG   ] Got command BAM from MCS: ref #1197885
2019-01-17 16:15:32 [INFO    ] Finished processing BAM request
2019-01-17 16:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197885   8 58500 58532025 A  ERROR'
2019-01-17 16:15:32 [DEBUG   ] Got command BAM from MCS: ref #1197884
2019-01-17 16:15:32 [INFO    ] Finished processing BAM request
2019-01-17 16:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197884   8 58500 58532029 A  ERROR'
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:15:32 [DEBUG   ] spawn_process: at 2019-01-17 16:15:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:15:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:16:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:16:05 [DEBUG   ] Got command RPT from MCS: ref #1197886
2019-01-17 16:16:05 [DEBUG   ] summary = ERROR
2019-01-17 16:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197886  13 58500 58565693 A  ERRORERROR'
2019-01-17 16:16:05 [DEBUG   ] Got command RPT from MCS: ref #1197887
2019-01-17 16:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197887  77 58500 58565694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:16:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-17 16:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:16:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:16:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:16:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:16:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:16:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:16:06 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-01-17 16:16:13 [DEBUG   ] Got command BAM from MCS: ref #1197904
2019-01-17 16:16:13 [INFO    ] Finished processing BAM request
2019-01-17 16:16:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197904   8 58500 58573025 A  ERROR'
2019-01-17 16:16:13 [DEBUG   ] Got command BAM from MCS: ref #1197903
2019-01-17 16:16:13 [INFO    ] Finished processing BAM request
2019-01-17 16:16:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197903   8 58500 58573029 A  ERROR'
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:16:13 [DEBUG   ] spawn_process: at 2019-01-17 16:16:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:16:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:16:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:16:54 [DEBUG   ] Got command BAM from MCS: ref #1197905
2019-01-17 16:16:54 [INFO    ] Finished processing BAM request
2019-01-17 16:16:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197905   8 58500 58614033 A  ERROR'
2019-01-17 16:16:54 [DEBUG   ] Got command BAM from MCS: ref #1197906
2019-01-17 16:16:54 [INFO    ] Finished processing BAM request
2019-01-17 16:16:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197906   8 58500 58614037 A  ERROR'
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:16:54 [DEBUG   ] spawn_process: at 2019-01-17 16:16:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:17:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 16:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 16:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:17:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:17:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:17:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:17:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:17:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:17:06 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-01-17 16:17:10 [DEBUG   ] Got command RPT from MCS: ref #1197909
2019-01-17 16:17:10 [DEBUG   ] summary = ERROR
2019-01-17 16:17:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197909  13 58500 58630693 A  ERRORERROR'
2019-01-17 16:17:10 [DEBUG   ] Got command RPT from MCS: ref #1197910
2019-01-17 16:17:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:17:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197910  77 58500 58630897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:17:11 [DEBUG   ] Got command RPT from MCS: ref #1197911
2019-01-17 16:17:11 [DEBUG   ] summary = ERROR
2019-01-17 16:17:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197911  13 58500 58631101 A  ERRORERROR'
2019-01-17 16:17:11 [DEBUG   ] Got command RPT from MCS: ref #1197912
2019-01-17 16:17:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:17:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197912  77 58500 58631293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:17:11 [DEBUG   ] Got command RPT from MCS: ref #1197914
2019-01-17 16:17:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:17:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197914  12 58500 58631497 A  ERRORB¢ff'
2019-01-17 16:17:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:17:35 [DEBUG   ] Got command BAM from MCS: ref #1197920
2019-01-17 16:17:35 [INFO    ] Finished processing BAM request
2019-01-17 16:17:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197920   8 58500 58655033 A  ERROR'
2019-01-17 16:17:35 [DEBUG   ] Got command BAM from MCS: ref #1197919
2019-01-17 16:17:35 [INFO    ] Finished processing BAM request
2019-01-17 16:17:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197919   8 58500 58655037 A  ERROR'
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:17:35 [DEBUG   ] spawn_process: at 2019-01-17 16:17:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:17:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:18:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 16:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:18:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-17 16:18:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:18:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:18:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:18:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:18:06 [DEBUG   ] Finished updating board flags in 1.501 seconds
2019-01-17 16:18:16 [DEBUG   ] Got command BAM from MCS: ref #1197921
2019-01-17 16:18:16 [INFO    ] Finished processing BAM request
2019-01-17 16:18:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197921   8 58500 58696029 A  ERROR'
2019-01-17 16:18:16 [DEBUG   ] Got command BAM from MCS: ref #1197922
2019-01-17 16:18:16 [INFO    ] Finished processing BAM request
2019-01-17 16:18:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197922   8 58500 58696033 A  ERROR'
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:18:16 [DEBUG   ] spawn_process: at 2019-01-17 16:18:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:18:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:18:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:18:57 [DEBUG   ] Got command BAM from MCS: ref #1197927
2019-01-17 16:18:57 [INFO    ] Finished processing BAM request
2019-01-17 16:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197927   8 58500 58737033 A  ERROR'
2019-01-17 16:18:57 [DEBUG   ] Got command BAM from MCS: ref #1197928
2019-01-17 16:18:57 [INFO    ] Finished processing BAM request
2019-01-17 16:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197928   8 58500 58737037 A  ERROR'
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:18:57 [DEBUG   ] spawn_process: at 2019-01-17 16:18:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:19:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 16:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:19:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:19:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:19:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:19:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:19:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:19:06 [DEBUG   ] Finished updating board flags in 1.314 seconds
2019-01-17 16:19:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:19:38 [DEBUG   ] Got command BAM from MCS: ref #1197930
2019-01-17 16:19:38 [INFO    ] Finished processing BAM request
2019-01-17 16:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197930   8 58500 58778033 A  ERROR'
2019-01-17 16:19:38 [DEBUG   ] Got command BAM from MCS: ref #1197929
2019-01-17 16:19:38 [INFO    ] Finished processing BAM request
2019-01-17 16:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197929   8 58500 58778037 A  ERROR'
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:19:38 [DEBUG   ] spawn_process: at 2019-01-17 16:19:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:19:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:20:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:20:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:20:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:20:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:20:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:20:06 [WARNING ] (13, 1, 'bot')
2019-01-17 16:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:20:06 [DEBUG   ] Finished updating board flags in 1.234 seconds
2019-01-17 16:20:19 [DEBUG   ] Got command BAM from MCS: ref #1197931
2019-01-17 16:20:19 [INFO    ] Finished processing BAM request
2019-01-17 16:20:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197931   8 58500 58819033 A  ERROR'
2019-01-17 16:20:19 [DEBUG   ] Got command BAM from MCS: ref #1197932
2019-01-17 16:20:19 [INFO    ] Finished processing BAM request
2019-01-17 16:20:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197932   8 58500 58819037 A  ERROR'
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:20:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:20:19 [DEBUG   ] spawn_process: at 2019-01-17 16:20:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:20:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:20:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:21:00 [DEBUG   ] Got command BAM from MCS: ref #1197934
2019-01-17 16:21:00 [INFO    ] Finished processing BAM request
2019-01-17 16:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197934   8 58500 58860025 A  ERROR'
2019-01-17 16:21:00 [DEBUG   ] Got command BAM from MCS: ref #1197933
2019-01-17 16:21:00 [INFO    ] Finished processing BAM request
2019-01-17 16:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197933   8 58500 58860029 A  ERROR'
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:21:00 [DEBUG   ] spawn_process: at 2019-01-17 16:21:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:21:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:21:05 [DEBUG   ] Got command RPT from MCS: ref #1197935
2019-01-17 16:21:05 [DEBUG   ] summary = ERROR
2019-01-17 16:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197935  13 58500 58865689 A  ERRORERROR'
2019-01-17 16:21:05 [DEBUG   ] Got command RPT from MCS: ref #1197936
2019-01-17 16:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197936  77 58500 58865690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:21:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:21:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:21:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:21:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:21:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:21:07 [DEBUG   ] Finished updating board flags in 1.744 seconds
2019-01-17 16:21:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:21:41 [DEBUG   ] Got command BAM from MCS: ref #1197956
2019-01-17 16:21:41 [INFO    ] Finished processing BAM request
2019-01-17 16:21:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197956   8 58500 58901033 A  ERROR'
2019-01-17 16:21:41 [DEBUG   ] Got command BAM from MCS: ref #1197957
2019-01-17 16:21:41 [INFO    ] Finished processing BAM request
2019-01-17 16:21:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197957   8 58500 58901037 A  ERROR'
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:21:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:21:41 [DEBUG   ] spawn_process: at 2019-01-17 16:21:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:21:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:22:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:22:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:22:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:22:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:22:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:22:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:22:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:22:07 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-17 16:22:10 [DEBUG   ] Got command RPT from MCS: ref #1197958
2019-01-17 16:22:10 [DEBUG   ] summary = ERROR
2019-01-17 16:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197958  13 58500 58930781 A  ERRORERROR'
2019-01-17 16:22:10 [DEBUG   ] Got command RPT from MCS: ref #1197959
2019-01-17 16:22:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197959  77 58500 58930985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:22:11 [DEBUG   ] Got command RPT from MCS: ref #1197960
2019-01-17 16:22:11 [DEBUG   ] summary = ERROR
2019-01-17 16:22:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197960  13 58500 58931177 A  ERRORERROR'
2019-01-17 16:22:11 [DEBUG   ] Got command RPT from MCS: ref #1197961
2019-01-17 16:22:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:22:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197961  77 58500 58931381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:22:11 [DEBUG   ] Got command RPT from MCS: ref #1197962
2019-01-17 16:22:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:22:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197962  12 58500 58931585 A  ERRORB¡ff'
2019-01-17 16:22:22 [DEBUG   ] Got command BAM from MCS: ref #1197963
2019-01-17 16:22:22 [INFO    ] Finished processing BAM request
2019-01-17 16:22:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197963   8 58500 58942029 A  ERROR'
2019-01-17 16:22:22 [DEBUG   ] Got command BAM from MCS: ref #1197964
2019-01-17 16:22:22 [INFO    ] Finished processing BAM request
2019-01-17 16:22:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197964   8 58500 58942033 A  ERROR'
2019-01-17 16:22:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:22:22 [DEBUG   ] spawn_process: at 2019-01-17 16:22:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:22:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:23:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:23:03 [DEBUG   ] Got command BAM from MCS: ref #1197965
2019-01-17 16:23:03 [INFO    ] Finished processing BAM request
2019-01-17 16:23:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197965   8 58500 58983029 A  ERROR'
2019-01-17 16:23:03 [DEBUG   ] Got command BAM from MCS: ref #1197966
2019-01-17 16:23:03 [INFO    ] Finished processing BAM request
2019-01-17 16:23:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197966   8 58500 58983033 A  ERROR'
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:23:03 [DEBUG   ] spawn_process: at 2019-01-17 16:23:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:23:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:23:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:23:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:23:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:23:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:23:07 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-17 16:23:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:23:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:23:44 [DEBUG   ] Got command BAM from MCS: ref #1197968
2019-01-17 16:23:44 [INFO    ] Finished processing BAM request
2019-01-17 16:23:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197968   8 58500 59024033 A  ERROR'
2019-01-17 16:23:44 [DEBUG   ] Got command BAM from MCS: ref #1197967
2019-01-17 16:23:44 [INFO    ] Finished processing BAM request
2019-01-17 16:23:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197967   8 58500 59024037 A  ERROR'
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:23:44 [DEBUG   ] spawn_process: at 2019-01-17 16:23:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:24:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:24:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:24:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:24:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:24:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:24:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:24:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:24:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:24:07 [DEBUG   ] Finished updating board flags in 1.260 seconds
2019-01-17 16:24:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:24:25 [DEBUG   ] Got command BAM from MCS: ref #1197973
2019-01-17 16:24:25 [INFO    ] Finished processing BAM request
2019-01-17 16:24:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197973   8 58500 59065029 A  ERROR'
2019-01-17 16:24:25 [DEBUG   ] Got command BAM from MCS: ref #1197974
2019-01-17 16:24:25 [INFO    ] Finished processing BAM request
2019-01-17 16:24:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197974   8 58500 59065033 A  ERROR'
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:24:25 [DEBUG   ] spawn_process: at 2019-01-17 16:24:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:24:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 16:25:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 16:25:06 [DEBUG   ] Got command BAM from MCS: ref #1197975
2019-01-17 16:25:06 [INFO    ] Finished processing BAM request
2019-01-17 16:25:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197975   8 58500 59106037 A  ERROR'
2019-01-17 16:25:06 [DEBUG   ] Got command BAM from MCS: ref #1197976
2019-01-17 16:25:06 [INFO    ] Finished processing BAM request
2019-01-17 16:25:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197976   8 58500 59106045 A  ERROR'
2019-01-17 16:25:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:25:06 [DEBUG   ] spawn_process: at 2019-01-17 16:25:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:25:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:25:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:25:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:25:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:25:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:25:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:25:07 [DEBUG   ] Finished updating board flags in 1.141 seconds
2019-01-17 16:25:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:25:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:25:47 [DEBUG   ] Got command BAM from MCS: ref #1197977
2019-01-17 16:25:47 [INFO    ] Finished processing BAM request
2019-01-17 16:25:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:25:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197977   8 58500 59147025 A  ERROR'
2019-01-17 16:25:47 [DEBUG   ] Got command BAM from MCS: ref #1197978
2019-01-17 16:25:47 [INFO    ] Finished processing BAM request
2019-01-17 16:25:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:25:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197978   8 58500 59147029 A  ERROR'
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:25:47 [DEBUG   ] spawn_process: at 2019-01-17 16:25:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:26:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:26:05 [DEBUG   ] Got command RPT from MCS: ref #1197979
2019-01-17 16:26:05 [DEBUG   ] summary = ERROR
2019-01-17 16:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197979  13 58500 59165697 A  ERRORERROR'
2019-01-17 16:26:05 [DEBUG   ] Got command RPT from MCS: ref #1197980
2019-01-17 16:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1197980  77 58500 59165698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:26:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:26:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:26:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:26:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:26:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:26:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:26:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:26:07 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-01-17 16:26:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:26:28 [DEBUG   ] Got command BAM from MCS: ref #1197996
2019-01-17 16:26:28 [INFO    ] Finished processing BAM request
2019-01-17 16:26:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:26:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197996   8 58500 59188025 A  ERROR'
2019-01-17 16:26:28 [DEBUG   ] Got command BAM from MCS: ref #1197997
2019-01-17 16:26:28 [INFO    ] Finished processing BAM request
2019-01-17 16:26:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:26:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1197997   8 58500 59188029 A  ERROR'
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:26:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:26:28 [DEBUG   ] spawn_process: at 2019-01-17 16:26:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:26:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:27:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:27:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:27:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:27:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:27:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:27:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:27:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:27:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:27:07 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-01-17 16:27:09 [DEBUG   ] Got command BAM from MCS: ref #1198001
2019-01-17 16:27:09 [INFO    ] Finished processing BAM request
2019-01-17 16:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198001   8 58500 59229025 A  ERROR'
2019-01-17 16:27:09 [DEBUG   ] Got command BAM from MCS: ref #1198000
2019-01-17 16:27:09 [INFO    ] Finished processing BAM request
2019-01-17 16:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198000   8 58500 59229029 A  ERROR'
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:27:09 [DEBUG   ] spawn_process: at 2019-01-17 16:27:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:27:10 [DEBUG   ] Got command RPT from MCS: ref #1198002
2019-01-17 16:27:10 [DEBUG   ] summary = ERROR
2019-01-17 16:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198002  13 58500 59230869 A  ERRORERROR'
2019-01-17 16:27:11 [DEBUG   ] Got command RPT from MCS: ref #1198003
2019-01-17 16:27:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198003  77 58500 59231073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:27:11 [DEBUG   ] Got command RPT from MCS: ref #1198004
2019-01-17 16:27:11 [DEBUG   ] summary = ERROR
2019-01-17 16:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198004  13 58500 59231265 A  ERRORERROR'
2019-01-17 16:27:11 [DEBUG   ] Got command RPT from MCS: ref #1198006
2019-01-17 16:27:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198006  77 58500 59231469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:27:11 [DEBUG   ] Got command RPT from MCS: ref #1198008
2019-01-17 16:27:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198008  12 58500 59231673 A  ERRORBŸff'
2019-01-17 16:27:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:27:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:27:50 [DEBUG   ] Got command BAM from MCS: ref #1198016
2019-01-17 16:27:50 [INFO    ] Finished processing BAM request
2019-01-17 16:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198016   8 58500 59270025 A  ERROR'
2019-01-17 16:27:50 [DEBUG   ] Got command BAM from MCS: ref #1198017
2019-01-17 16:27:50 [INFO    ] Finished processing BAM request
2019-01-17 16:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198017   8 58500 59270029 A  ERROR'
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:27:50 [DEBUG   ] spawn_process: at 2019-01-17 16:27:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:28:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:28:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:28:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:28:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:28:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:28:08 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-17 16:28:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:28:31 [DEBUG   ] Got command BAM from MCS: ref #1198018
2019-01-17 16:28:31 [INFO    ] Finished processing BAM request
2019-01-17 16:28:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198018   8 58500 59311025 A  ERROR'
2019-01-17 16:28:31 [DEBUG   ] Got command BAM from MCS: ref #1198019
2019-01-17 16:28:31 [INFO    ] Finished processing BAM request
2019-01-17 16:28:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198019   8 58500 59311029 A  ERROR'
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:28:31 [DEBUG   ] spawn_process: at 2019-01-17 16:28:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:28:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:29:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:29:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:29:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:29:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:29:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:29:07 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-17 16:29:12 [DEBUG   ] Got command BAM from MCS: ref #1198021
2019-01-17 16:29:12 [INFO    ] Finished processing BAM request
2019-01-17 16:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198021   8 58500 59352025 A  ERROR'
2019-01-17 16:29:12 [DEBUG   ] Got command BAM from MCS: ref #1198020
2019-01-17 16:29:12 [INFO    ] Finished processing BAM request
2019-01-17 16:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198020   8 58500 59352029 A  ERROR'
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:29:12 [DEBUG   ] spawn_process: at 2019-01-17 16:29:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:29:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:29:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:29:53 [DEBUG   ] Got command BAM from MCS: ref #1198023
2019-01-17 16:29:53 [INFO    ] Finished processing BAM request
2019-01-17 16:29:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198023   8 58500 59393025 A  ERROR'
2019-01-17 16:29:53 [DEBUG   ] Got command BAM from MCS: ref #1198022
2019-01-17 16:29:53 [INFO    ] Finished processing BAM request
2019-01-17 16:29:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198022   8 58500 59393029 A  ERROR'
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:29:53 [DEBUG   ] spawn_process: at 2019-01-17 16:29:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:30:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 16:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:30:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:30:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:30:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:30:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:30:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:30:07 [DEBUG   ] Finished updating board flags in 1.269 seconds
2019-01-17 16:30:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:30:34 [DEBUG   ] Got command BAM from MCS: ref #1198029
2019-01-17 16:30:34 [INFO    ] Finished processing BAM request
2019-01-17 16:30:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198029   8 58500 59434025 A  ERROR'
2019-01-17 16:30:34 [DEBUG   ] Got command BAM from MCS: ref #1198028
2019-01-17 16:30:34 [INFO    ] Finished processing BAM request
2019-01-17 16:30:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198028   8 58500 59434029 A  ERROR'
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:30:34 [DEBUG   ] spawn_process: at 2019-01-17 16:30:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:30:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:31:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:31:05 [DEBUG   ] Got command RPT from MCS: ref #1198030
2019-01-17 16:31:05 [DEBUG   ] summary = ERROR
2019-01-17 16:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198030  13 58500 59465689 A  ERRORERROR'
2019-01-17 16:31:05 [DEBUG   ] Got command RPT from MCS: ref #1198031
2019-01-17 16:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198031  77 58500 59465690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 16:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:31:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:31:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:31:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:31:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:31:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:31:07 [DEBUG   ] Finished updating board flags in 1.140 seconds
2019-01-17 16:31:15 [DEBUG   ] Got command BAM from MCS: ref #1198048
2019-01-17 16:31:15 [INFO    ] Finished processing BAM request
2019-01-17 16:31:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198048   8 58500 59475029 A  ERROR'
2019-01-17 16:31:15 [DEBUG   ] Got command BAM from MCS: ref #1198047
2019-01-17 16:31:15 [INFO    ] Finished processing BAM request
2019-01-17 16:31:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198047   8 58500 59475033 A  ERROR'
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:31:15 [DEBUG   ] spawn_process: at 2019-01-17 16:31:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:31:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:31:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:31:56 [DEBUG   ] Got command BAM from MCS: ref #1198050
2019-01-17 16:31:56 [INFO    ] Finished processing BAM request
2019-01-17 16:31:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198050   8 58500 59516025 A  ERROR'
2019-01-17 16:31:56 [DEBUG   ] Got command BAM from MCS: ref #1198049
2019-01-17 16:31:56 [INFO    ] Finished processing BAM request
2019-01-17 16:31:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198049   8 58500 59516029 A  ERROR'
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:31:56 [DEBUG   ] spawn_process: at 2019-01-17 16:31:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:32:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:32:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:32:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:32:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:32:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:32:07 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-17 16:32:10 [DEBUG   ] Got command RPT from MCS: ref #1198051
2019-01-17 16:32:10 [DEBUG   ] summary = ERROR
2019-01-17 16:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198051  13 58500 59530957 A  ERRORERROR'
2019-01-17 16:32:11 [DEBUG   ] Got command RPT from MCS: ref #1198052
2019-01-17 16:32:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198052  77 58500 59531149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:32:11 [DEBUG   ] Got command RPT from MCS: ref #1198053
2019-01-17 16:32:11 [DEBUG   ] summary = ERROR
2019-01-17 16:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198053  13 58500 59531353 A  ERRORERROR'
2019-01-17 16:32:11 [DEBUG   ] Got command RPT from MCS: ref #1198054
2019-01-17 16:32:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198054  77 58500 59531557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:32:11 [DEBUG   ] Got command RPT from MCS: ref #1198055
2019-01-17 16:32:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198055  12 58500 59531753 A  ERRORBŸff'
2019-01-17 16:32:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:32:37 [DEBUG   ] Got command BAM from MCS: ref #1198057
2019-01-17 16:32:37 [INFO    ] Finished processing BAM request
2019-01-17 16:32:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198057   8 58500 59557033 A  ERROR'
2019-01-17 16:32:37 [DEBUG   ] Got command BAM from MCS: ref #1198056
2019-01-17 16:32:37 [INFO    ] Finished processing BAM request
2019-01-17 16:32:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198056   8 58500 59557037 A  ERROR'
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:32:37 [DEBUG   ] spawn_process: at 2019-01-17 16:32:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:32:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 16:33:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-17 16:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:33:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:33:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:33:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:33:07 [WARNING ] (13, 1, 'bot')
2019-01-17 16:33:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:33:07 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-17 16:33:18 [DEBUG   ] Got command BAM from MCS: ref #1198059
2019-01-17 16:33:18 [INFO    ] Finished processing BAM request
2019-01-17 16:33:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198059   8 58500 59598029 A  ERROR'
2019-01-17 16:33:18 [DEBUG   ] Got command BAM from MCS: ref #1198058
2019-01-17 16:33:18 [INFO    ] Finished processing BAM request
2019-01-17 16:33:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198058   8 58500 59598033 A  ERROR'
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:33:18 [DEBUG   ] spawn_process: at 2019-01-17 16:33:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:33:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:33:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:33:59 [DEBUG   ] Got command BAM from MCS: ref #1198064
2019-01-17 16:33:59 [INFO    ] Finished processing BAM request
2019-01-17 16:33:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198064   8 58500 59639025 A  ERROR'
2019-01-17 16:33:59 [DEBUG   ] Got command BAM from MCS: ref #1198065
2019-01-17 16:33:59 [INFO    ] Finished processing BAM request
2019-01-17 16:33:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198065   8 58500 59639029 A  ERROR'
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:33:59 [DEBUG   ] spawn_process: at 2019-01-17 16:33:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:34:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:34:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:34:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:34:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:34:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:34:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:34:08 [DEBUG   ] Finished updating board flags in 1.560 seconds
2019-01-17 16:34:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:34:40 [DEBUG   ] Got command BAM from MCS: ref #1198066
2019-01-17 16:34:40 [INFO    ] Finished processing BAM request
2019-01-17 16:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198066   8 58500 59680025 A  ERROR'
2019-01-17 16:34:40 [DEBUG   ] Got command BAM from MCS: ref #1198067
2019-01-17 16:34:40 [INFO    ] Finished processing BAM request
2019-01-17 16:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198067   8 58500 59680029 A  ERROR'
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:34:40 [DEBUG   ] spawn_process: at 2019-01-17 16:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:34:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:35:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 16:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:35:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:35:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:35:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:35:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:35:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:35:08 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-01-17 16:35:21 [DEBUG   ] Got command BAM from MCS: ref #1198068
2019-01-17 16:35:21 [INFO    ] Finished processing BAM request
2019-01-17 16:35:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198068   8 58500 59721025 A  ERROR'
2019-01-17 16:35:21 [DEBUG   ] Got command BAM from MCS: ref #1198069
2019-01-17 16:35:21 [INFO    ] Finished processing BAM request
2019-01-17 16:35:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198069   8 58500 59721029 A  ERROR'
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:35:21 [DEBUG   ] spawn_process: at 2019-01-17 16:35:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:35:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:35:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:36:02 [DEBUG   ] Got command BAM from MCS: ref #1198070
2019-01-17 16:36:02 [INFO    ] Finished processing BAM request
2019-01-17 16:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198070   8 58500 59762029 A  ERROR'
2019-01-17 16:36:02 [DEBUG   ] Got command BAM from MCS: ref #1198071
2019-01-17 16:36:02 [INFO    ] Finished processing BAM request
2019-01-17 16:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198071   8 58500 59762033 A  ERROR'
2019-01-17 16:36:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:36:02 [DEBUG   ] spawn_process: at 2019-01-17 16:36:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:36:05 [DEBUG   ] Got command RPT from MCS: ref #1198072
2019-01-17 16:36:05 [DEBUG   ] summary = ERROR
2019-01-17 16:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198072  13 58500 59765697 A  ERRORERROR'
2019-01-17 16:36:05 [DEBUG   ] Got command RPT from MCS: ref #1198073
2019-01-17 16:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198073  77 58500 59765698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-17 16:36:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:36:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:36:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:36:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:36:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:36:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:36:08 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-01-17 16:36:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:36:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:36:43 [DEBUG   ] Got command BAM from MCS: ref #1198093
2019-01-17 16:36:43 [INFO    ] Finished processing BAM request
2019-01-17 16:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198093   8 58500 59803029 A  ERROR'
2019-01-17 16:36:43 [DEBUG   ] Got command BAM from MCS: ref #1198094
2019-01-17 16:36:43 [INFO    ] Finished processing BAM request
2019-01-17 16:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198094   8 58500 59803033 A  ERROR'
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:36:43 [DEBUG   ] spawn_process: at 2019-01-17 16:36:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:37:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:37:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 16:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:37:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:37:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:37:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:37:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:37:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:37:08 [DEBUG   ] Finished updating board flags in 1.252 seconds
2019-01-17 16:37:11 [DEBUG   ] Got command RPT from MCS: ref #1198097
2019-01-17 16:37:11 [DEBUG   ] summary = ERROR
2019-01-17 16:37:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198097  13 58500 59831037 A  ERRORERROR'
2019-01-17 16:37:11 [DEBUG   ] Got command RPT from MCS: ref #1198098
2019-01-17 16:37:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:37:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198098  77 58500 59831241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:37:11 [DEBUG   ] Got command RPT from MCS: ref #1198099
2019-01-17 16:37:11 [DEBUG   ] summary = ERROR
2019-01-17 16:37:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198099  13 58500 59831445 A  ERRORERROR'
2019-01-17 16:37:11 [DEBUG   ] Got command RPT from MCS: ref #1198101
2019-01-17 16:37:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:37:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198101  77 58500 59831637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:37:11 [DEBUG   ] Got command RPT from MCS: ref #1198102
2019-01-17 16:37:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:37:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198102  12 58500 59831841 A  ERRORB¡ff'
2019-01-17 16:37:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:37:24 [DEBUG   ] Got command BAM from MCS: ref #1198108
2019-01-17 16:37:24 [INFO    ] Finished processing BAM request
2019-01-17 16:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198108   8 58500 59844029 A  ERROR'
2019-01-17 16:37:24 [DEBUG   ] Got command BAM from MCS: ref #1198107
2019-01-17 16:37:24 [INFO    ] Finished processing BAM request
2019-01-17 16:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198107   8 58500 59844033 A  ERROR'
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:37:24 [DEBUG   ] spawn_process: at 2019-01-17 16:37:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:37:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:38:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:38:05 [DEBUG   ] Got command BAM from MCS: ref #1198110
2019-01-17 16:38:05 [INFO    ] Finished processing BAM request
2019-01-17 16:38:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198110   8 58500 59885033 A  ERROR'
2019-01-17 16:38:05 [DEBUG   ] Got command BAM from MCS: ref #1198109
2019-01-17 16:38:05 [INFO    ] Finished processing BAM request
2019-01-17 16:38:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198109   8 58500 59885037 A  ERROR'
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:38:05 [DEBUG   ] spawn_process: at 2019-01-17 16:38:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-17 16:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:38:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:38:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:38:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:38:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:38:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:38:08 [DEBUG   ] Finished updating board flags in 1.139 seconds
2019-01-17 16:38:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:38:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:38:46 [DEBUG   ] Got command BAM from MCS: ref #1198111
2019-01-17 16:38:46 [INFO    ] Finished processing BAM request
2019-01-17 16:38:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198111   8 58500 59926033 A  ERROR'
2019-01-17 16:38:46 [DEBUG   ] Got command BAM from MCS: ref #1198112
2019-01-17 16:38:46 [INFO    ] Finished processing BAM request
2019-01-17 16:38:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198112   8 58500 59926037 A  ERROR'
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:38:46 [DEBUG   ] spawn_process: at 2019-01-17 16:38:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:39:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:39:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:39:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:39:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:39:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:39:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:39:08 [DEBUG   ] Finished updating board flags in 1.036 seconds
2019-01-17 16:39:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:39:27 [DEBUG   ] Got command BAM from MCS: ref #1198117
2019-01-17 16:39:27 [INFO    ] Finished processing BAM request
2019-01-17 16:39:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198117   8 58500 59967033 A  ERROR'
2019-01-17 16:39:27 [DEBUG   ] Got command BAM from MCS: ref #1198118
2019-01-17 16:39:27 [INFO    ] Finished processing BAM request
2019-01-17 16:39:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198118   8 58500 59967037 A  ERROR'
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:39:27 [DEBUG   ] spawn_process: at 2019-01-17 16:39:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:39:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:40:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:40:08 [DEBUG   ] Got command BAM from MCS: ref #1198119
2019-01-17 16:40:08 [INFO    ] Finished processing BAM request
2019-01-17 16:40:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198119   8 58500 60008025 A  ERROR'
2019-01-17 16:40:08 [DEBUG   ] Got command BAM from MCS: ref #1198120
2019-01-17 16:40:08 [INFO    ] Finished processing BAM request
2019-01-17 16:40:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198120   8 58500 60008029 A  ERROR'
2019-01-17 16:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:40:08 [DEBUG   ] spawn_process: at 2019-01-17 16:40:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 16:40:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-17 16:40:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:40:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:40:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:40:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:40:09 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-01-17 16:40:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:40:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:40:49 [DEBUG   ] Got command BAM from MCS: ref #1198122
2019-01-17 16:40:49 [INFO    ] Finished processing BAM request
2019-01-17 16:40:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198122   8 58500 60049029 A  ERROR'
2019-01-17 16:40:49 [DEBUG   ] Got command BAM from MCS: ref #1198121
2019-01-17 16:40:49 [INFO    ] Finished processing BAM request
2019-01-17 16:40:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198121   8 58500 60049033 A  ERROR'
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:40:49 [DEBUG   ] spawn_process: at 2019-01-17 16:40:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:41:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:41:05 [DEBUG   ] Got command RPT from MCS: ref #1198123
2019-01-17 16:41:05 [DEBUG   ] summary = ERROR
2019-01-17 16:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198123  13 58500 60065701 A  ERRORERROR'
2019-01-17 16:41:05 [DEBUG   ] Got command RPT from MCS: ref #1198124
2019-01-17 16:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198124  77 58500 60065702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:41:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:41:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:41:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:41:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:41:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:41:08 [DEBUG   ] Finished updating board flags in 1.242 seconds
2019-01-17 16:41:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:41:30 [DEBUG   ] Got command BAM from MCS: ref #1198141
2019-01-17 16:41:30 [INFO    ] Finished processing BAM request
2019-01-17 16:41:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198141   8 58500 60090025 A  ERROR'
2019-01-17 16:41:30 [DEBUG   ] Got command BAM from MCS: ref #1198140
2019-01-17 16:41:30 [INFO    ] Finished processing BAM request
2019-01-17 16:41:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198140   8 58500 60090029 A  ERROR'
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:41:30 [DEBUG   ] spawn_process: at 2019-01-17 16:41:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:41:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:42:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:42:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-17 16:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:42:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:42:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:42:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:42:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:42:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:42:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:42:08 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-01-17 16:42:11 [DEBUG   ] Got command BAM from MCS: ref #1198143
2019-01-17 16:42:11 [INFO    ] Finished processing BAM request
2019-01-17 16:42:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198143   8 58500 60131029 A  ERROR'
2019-01-17 16:42:11 [DEBUG   ] Got command BAM from MCS: ref #1198142
2019-01-17 16:42:11 [INFO    ] Finished processing BAM request
2019-01-17 16:42:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198142   8 58500 60131033 A  ERROR'
2019-01-17 16:42:11 [DEBUG   ] Got command RPT from MCS: ref #1198144
2019-01-17 16:42:11 [DEBUG   ] summary = ERROR
2019-01-17 16:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198144  13 58500 60131129 A  ERRORERROR'
2019-01-17 16:42:11 [DEBUG   ] Got command RPT from MCS: ref #1198145
2019-01-17 16:42:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198145  77 58500 60131321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:42:11 [DEBUG   ] Got command RPT from MCS: ref #1198146
2019-01-17 16:42:11 [DEBUG   ] summary = ERROR
2019-01-17 16:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198146  13 58500 60131525 A  ERRORERROR'
2019-01-17 16:42:11 [DEBUG   ] Got command RPT from MCS: ref #1198147
2019-01-17 16:42:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198147  77 58500 60131729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:42:11 [DEBUG   ] Got command RPT from MCS: ref #1198148
2019-01-17 16:42:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198148  12 58500 60131934 A  ERRORB ff'
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:42:11 [DEBUG   ] spawn_process: at 2019-01-17 16:42:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:42:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:42:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:42:52 [DEBUG   ] Got command BAM from MCS: ref #1198154
2019-01-17 16:42:52 [INFO    ] Finished processing BAM request
2019-01-17 16:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198154   8 58500 60172029 A  ERROR'
2019-01-17 16:42:52 [DEBUG   ] Got command BAM from MCS: ref #1198153
2019-01-17 16:42:52 [INFO    ] Finished processing BAM request
2019-01-17 16:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198153   8 58500 60172033 A  ERROR'
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:42:52 [DEBUG   ] spawn_process: at 2019-01-17 16:42:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:43:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:43:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:43:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:43:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:43:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:43:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:43:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:43:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:43:08 [DEBUG   ] Finished updating board flags in 1.253 seconds
2019-01-17 16:43:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:43:33 [DEBUG   ] Got command BAM from MCS: ref #1198156
2019-01-17 16:43:33 [INFO    ] Finished processing BAM request
2019-01-17 16:43:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198156   8 58500 60213029 A  ERROR'
2019-01-17 16:43:33 [DEBUG   ] Got command BAM from MCS: ref #1198155
2019-01-17 16:43:33 [INFO    ] Finished processing BAM request
2019-01-17 16:43:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198155   8 58500 60213033 A  ERROR'
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:43:33 [DEBUG   ] spawn_process: at 2019-01-17 16:43:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:43:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:44:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 16:44:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:44:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:44:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:44:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:44:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:44:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:44:08 [DEBUG   ] Finished updating board flags in 1.223 seconds
2019-01-17 16:44:14 [DEBUG   ] Got command BAM from MCS: ref #1198158
2019-01-17 16:44:14 [INFO    ] Finished processing BAM request
2019-01-17 16:44:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198158   8 58500 60254033 A  ERROR'
2019-01-17 16:44:14 [DEBUG   ] Got command BAM from MCS: ref #1198157
2019-01-17 16:44:14 [INFO    ] Finished processing BAM request
2019-01-17 16:44:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198157   8 58500 60254037 A  ERROR'
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:44:14 [DEBUG   ] spawn_process: at 2019-01-17 16:44:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:44:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:44:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:44:55 [DEBUG   ] Got command BAM from MCS: ref #1198159
2019-01-17 16:44:55 [INFO    ] Finished processing BAM request
2019-01-17 16:44:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198159   8 58500 60295025 A  ERROR'
2019-01-17 16:44:55 [DEBUG   ] Got command BAM from MCS: ref #1198160
2019-01-17 16:44:55 [INFO    ] Finished processing BAM request
2019-01-17 16:44:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198160   8 58500 60295029 A  ERROR'
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:44:55 [DEBUG   ] spawn_process: at 2019-01-17 16:44:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:45:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 16:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:45:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:45:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:45:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:45:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:45:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:45:09 [DEBUG   ] Finished updating board flags in 1.760 seconds
2019-01-17 16:45:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:45:36 [DEBUG   ] Got command BAM from MCS: ref #1198166
2019-01-17 16:45:36 [INFO    ] Finished processing BAM request
2019-01-17 16:45:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198166   8 58500 60336033 A  ERROR'
2019-01-17 16:45:36 [DEBUG   ] Got command BAM from MCS: ref #1198165
2019-01-17 16:45:36 [INFO    ] Finished processing BAM request
2019-01-17 16:45:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198165   8 58500 60336037 A  ERROR'
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:45:36 [DEBUG   ] spawn_process: at 2019-01-17 16:45:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:45:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:46:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:46:05 [DEBUG   ] Got command RPT from MCS: ref #1198167
2019-01-17 16:46:05 [DEBUG   ] summary = ERROR
2019-01-17 16:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198167  13 58500 60365697 A  ERRORERROR'
2019-01-17 16:46:05 [DEBUG   ] Got command RPT from MCS: ref #1198168
2019-01-17 16:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198168  77 58500 60365698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:46:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:46:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-17 16:46:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:46:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:46:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:46:08 [WARNING ] (13, 1, 'bot')
2019-01-17 16:46:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:46:08 [DEBUG   ] Finished updating board flags in 0.979 seconds
2019-01-17 16:46:17 [DEBUG   ] Got command BAM from MCS: ref #1198185
2019-01-17 16:46:17 [INFO    ] Finished processing BAM request
2019-01-17 16:46:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198185   8 58500 60377033 A  ERROR'
2019-01-17 16:46:17 [DEBUG   ] Got command BAM from MCS: ref #1198184
2019-01-17 16:46:17 [INFO    ] Finished processing BAM request
2019-01-17 16:46:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198184   8 58500 60377037 A  ERROR'
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:46:17 [DEBUG   ] spawn_process: at 2019-01-17 16:46:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:46:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:46:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:46:58 [DEBUG   ] Got command BAM from MCS: ref #1198186
2019-01-17 16:46:58 [INFO    ] Finished processing BAM request
2019-01-17 16:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198186   8 58500 60418025 A  ERROR'
2019-01-17 16:46:58 [DEBUG   ] Got command BAM from MCS: ref #1198187
2019-01-17 16:46:58 [INFO    ] Finished processing BAM request
2019-01-17 16:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198187   8 58500 60418029 A  ERROR'
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:46:58 [DEBUG   ] spawn_process: at 2019-01-17 16:46:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:47:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:47:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:47:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:47:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:47:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:47:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:47:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:47:09 [DEBUG   ] Finished updating board flags in 1.342 seconds
2019-01-17 16:47:11 [DEBUG   ] Got command RPT from MCS: ref #1198190
2019-01-17 16:47:11 [DEBUG   ] summary = ERROR
2019-01-17 16:47:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198190  13 58500 60431213 A  ERRORERROR'
2019-01-17 16:47:11 [DEBUG   ] Got command RPT from MCS: ref #1198191
2019-01-17 16:47:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:47:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198191  77 58500 60431417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:47:11 [DEBUG   ] Got command RPT from MCS: ref #1198192
2019-01-17 16:47:11 [DEBUG   ] summary = ERROR
2019-01-17 16:47:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198192  13 58500 60431609 A  ERRORERROR'
2019-01-17 16:47:11 [DEBUG   ] Got command RPT from MCS: ref #1198194
2019-01-17 16:47:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:47:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198194  77 58500 60431813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:47:12 [DEBUG   ] Got command RPT from MCS: ref #1198195
2019-01-17 16:47:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198195  12 58500 60432017 A  ERRORB ff'
2019-01-17 16:47:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:47:39 [DEBUG   ] Got command BAM from MCS: ref #1198200
2019-01-17 16:47:39 [INFO    ] Finished processing BAM request
2019-01-17 16:47:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198200   8 58500 60459033 A  ERROR'
2019-01-17 16:47:39 [DEBUG   ] Got command BAM from MCS: ref #1198201
2019-01-17 16:47:39 [INFO    ] Finished processing BAM request
2019-01-17 16:47:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198201   8 58500 60459037 A  ERROR'
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:47:39 [DEBUG   ] spawn_process: at 2019-01-17 16:47:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:47:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:48:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 16:48:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:48:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:48:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:48:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:48:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:48:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:48:09 [DEBUG   ] Finished updating board flags in 1.198 seconds
2019-01-17 16:48:20 [DEBUG   ] Got command BAM from MCS: ref #1198207
2019-01-17 16:48:20 [INFO    ] Finished processing BAM request
2019-01-17 16:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198207   8 58500 60500033 A  ERROR'
2019-01-17 16:48:20 [DEBUG   ] Got command BAM from MCS: ref #1198206
2019-01-17 16:48:20 [INFO    ] Finished processing BAM request
2019-01-17 16:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198206   8 58500 60500037 A  ERROR'
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:48:20 [DEBUG   ] spawn_process: at 2019-01-17 16:48:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:48:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:48:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:49:01 [DEBUG   ] Got command BAM from MCS: ref #1198208
2019-01-17 16:49:01 [INFO    ] Finished processing BAM request
2019-01-17 16:49:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198208   8 58500 60541033 A  ERROR'
2019-01-17 16:49:01 [DEBUG   ] Got command BAM from MCS: ref #1198209
2019-01-17 16:49:01 [INFO    ] Finished processing BAM request
2019-01-17 16:49:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198209   8 58500 60541037 A  ERROR'
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:49:01 [DEBUG   ] spawn_process: at 2019-01-17 16:49:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:49:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:49:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:49:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:49:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:49:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:49:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:49:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:49:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:49:09 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-01-17 16:49:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:49:42 [DEBUG   ] Got command BAM from MCS: ref #1198211
2019-01-17 16:49:42 [INFO    ] Finished processing BAM request
2019-01-17 16:49:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:49:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198211   8 58500 60582029 A  ERROR'
2019-01-17 16:49:42 [DEBUG   ] Got command BAM from MCS: ref #1198210
2019-01-17 16:49:42 [INFO    ] Finished processing BAM request
2019-01-17 16:49:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:49:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198210   8 58500 60582033 A  ERROR'
2019-01-17 16:49:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:49:42 [DEBUG   ] spawn_process: at 2019-01-17 16:49:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:50:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:50:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 16:50:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:50:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:50:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:50:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:50:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:50:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:50:09 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-17 16:50:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:50:23 [DEBUG   ] Got command BAM from MCS: ref #1198212
2019-01-17 16:50:23 [INFO    ] Finished processing BAM request
2019-01-17 16:50:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198212   8 58500 60623033 A  ERROR'
2019-01-17 16:50:23 [DEBUG   ] Got command BAM from MCS: ref #1198213
2019-01-17 16:50:23 [INFO    ] Finished processing BAM request
2019-01-17 16:50:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198213   8 58500 60623037 A  ERROR'
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:50:23 [DEBUG   ] spawn_process: at 2019-01-17 16:50:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:50:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:51:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:51:04 [DEBUG   ] Got command BAM from MCS: ref #1198215
2019-01-17 16:51:04 [INFO    ] Finished processing BAM request
2019-01-17 16:51:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198215   8 58500 60664025 A  ERROR'
2019-01-17 16:51:04 [DEBUG   ] Got command BAM from MCS: ref #1198214
2019-01-17 16:51:04 [INFO    ] Finished processing BAM request
2019-01-17 16:51:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:51:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198214   8 58500 60664029 A  ERROR'
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:51:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:51:04 [DEBUG   ] spawn_process: at 2019-01-17 16:51:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:51:05 [DEBUG   ] Got command RPT from MCS: ref #1198216
2019-01-17 16:51:05 [DEBUG   ] summary = ERROR
2019-01-17 16:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198216  13 58500 60665701 A  ERRORERROR'
2019-01-17 16:51:05 [DEBUG   ] Got command RPT from MCS: ref #1198217
2019-01-17 16:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198217  77 58500 60665702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:51:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:51:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:51:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:51:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:51:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:51:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:51:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:51:09 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-17 16:51:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:51:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:51:45 [DEBUG   ] Got command BAM from MCS: ref #1198237
2019-01-17 16:51:45 [INFO    ] Finished processing BAM request
2019-01-17 16:51:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198237   8 58500 60705033 A  ERROR'
2019-01-17 16:51:45 [DEBUG   ] Got command BAM from MCS: ref #1198238
2019-01-17 16:51:45 [INFO    ] Finished processing BAM request
2019-01-17 16:51:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198238   8 58500 60705037 A  ERROR'
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:51:45 [DEBUG   ] spawn_process: at 2019-01-17 16:51:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:52:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:52:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:52:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:52:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:52:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:52:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:52:10 [DEBUG   ] Finished updating board flags in 1.869 seconds
2019-01-17 16:52:11 [DEBUG   ] Got command RPT from MCS: ref #1198239
2019-01-17 16:52:11 [DEBUG   ] summary = ERROR
2019-01-17 16:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198239  13 58500 60731293 A  ERRORERROR'
2019-01-17 16:52:11 [DEBUG   ] Got command RPT from MCS: ref #1198240
2019-01-17 16:52:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198240  77 58500 60731497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:52:11 [DEBUG   ] Got command RPT from MCS: ref #1198241
2019-01-17 16:52:11 [DEBUG   ] summary = ERROR
2019-01-17 16:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198241  13 58500 60731701 A  ERRORERROR'
2019-01-17 16:52:11 [DEBUG   ] Got command RPT from MCS: ref #1198242
2019-01-17 16:52:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198242  77 58500 60731893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:52:12 [DEBUG   ] Got command RPT from MCS: ref #1198243
2019-01-17 16:52:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:52:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198243  12 58500 60732097 A  ERRORBŸff'
2019-01-17 16:52:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:52:26 [DEBUG   ] Got command BAM from MCS: ref #1198244
2019-01-17 16:52:26 [INFO    ] Finished processing BAM request
2019-01-17 16:52:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198244   8 58500 60746025 A  ERROR'
2019-01-17 16:52:26 [DEBUG   ] Got command BAM from MCS: ref #1198245
2019-01-17 16:52:26 [INFO    ] Finished processing BAM request
2019-01-17 16:52:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198245   8 58500 60746029 A  ERROR'
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:52:26 [DEBUG   ] spawn_process: at 2019-01-17 16:52:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:52:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:53:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 16:53:07 [DEBUG   ] Got command BAM from MCS: ref #1198246
2019-01-17 16:53:07 [INFO    ] Finished processing BAM request
2019-01-17 16:53:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198246   8 58500 60787033 A  ERROR'
2019-01-17 16:53:07 [DEBUG   ] Got command BAM from MCS: ref #1198247
2019-01-17 16:53:07 [INFO    ] Finished processing BAM request
2019-01-17 16:53:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198247   8 58500 60787037 A  ERROR'
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:53:07 [DEBUG   ] spawn_process: at 2019-01-17 16:53:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:53:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:53:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:53:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:53:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:53:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:53:09 [DEBUG   ] Finished updating board flags in 1.160 seconds
2019-01-17 16:53:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:53:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:53:48 [DEBUG   ] Got command BAM from MCS: ref #1198248
2019-01-17 16:53:48 [INFO    ] Finished processing BAM request
2019-01-17 16:53:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198248   8 58500 60828033 A  ERROR'
2019-01-17 16:53:48 [DEBUG   ] Got command BAM from MCS: ref #1198249
2019-01-17 16:53:48 [INFO    ] Finished processing BAM request
2019-01-17 16:53:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198249   8 58500 60828037 A  ERROR'
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:53:48 [DEBUG   ] spawn_process: at 2019-01-17 16:53:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:54:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 16:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:54:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:54:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:54:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:54:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:54:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:54:09 [DEBUG   ] Finished updating board flags in 1.033 seconds
2019-01-17 16:54:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:54:29 [DEBUG   ] Got command BAM from MCS: ref #1198254
2019-01-17 16:54:29 [INFO    ] Finished processing BAM request
2019-01-17 16:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198254   8 58500 60869033 A  ERROR'
2019-01-17 16:54:29 [DEBUG   ] Got command BAM from MCS: ref #1198255
2019-01-17 16:54:29 [INFO    ] Finished processing BAM request
2019-01-17 16:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198255   8 58500 60869037 A  ERROR'
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 16:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 16:54:29 [DEBUG   ] spawn_process: at 2019-01-17 16:54:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 16:54:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:55:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 16:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 16:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:55:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:55:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:55:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:55:09 [WARNING ] (13, 1, 'bot')
2019-01-17 16:55:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:55:09 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-01-17 16:55:11 [DEBUG   ] Got command BAM from MCS: ref #1198257
2019-01-17 16:55:11 [INFO    ] Finished processing BAM request
2019-01-17 16:55:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198257   8 58500 60911033 A  ERROR'
2019-01-17 16:55:11 [DEBUG   ] Got command BAM from MCS: ref #1198256
2019-01-17 16:55:11 [INFO    ] Finished processing BAM request
2019-01-17 16:55:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198256   8 58500 60911037 A  ERROR'
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:55:11 [DEBUG   ] spawn_process: at 2019-01-17 16:55:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:55:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:55:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:55:53 [DEBUG   ] Got command BAM from MCS: ref #1198259
2019-01-17 16:55:53 [INFO    ] Finished processing BAM request
2019-01-17 16:55:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:55:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198259   8 58500 60953033 A  ERROR'
2019-01-17 16:55:53 [DEBUG   ] Got command BAM from MCS: ref #1198258
2019-01-17 16:55:53 [INFO    ] Finished processing BAM request
2019-01-17 16:55:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:55:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198258   8 58500 60953037 A  ERROR'
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:55:53 [DEBUG   ] spawn_process: at 2019-01-17 16:55:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:56:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 16:56:05 [DEBUG   ] Got command RPT from MCS: ref #1198260
2019-01-17 16:56:05 [DEBUG   ] summary = ERROR
2019-01-17 16:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198260  13 58500 60965705 A  ERRORERROR'
2019-01-17 16:56:05 [DEBUG   ] Got command RPT from MCS: ref #1198261
2019-01-17 16:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198261  77 58500 60965706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:56:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:56:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 16:56:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:56:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:56:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:56:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:56:10 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-01-17 16:56:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 16:56:35 [DEBUG   ] Got command BAM from MCS: ref #1198277
2019-01-17 16:56:35 [INFO    ] Finished processing BAM request
2019-01-17 16:56:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198277   8 58500 60995033 A  ERROR'
2019-01-17 16:56:35 [DEBUG   ] Got command BAM from MCS: ref #1198278
2019-01-17 16:56:35 [INFO    ] Finished processing BAM request
2019-01-17 16:56:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198278   8 58500 60995037 A  ERROR'
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 16:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 16:56:35 [DEBUG   ] spawn_process: at 2019-01-17 16:56:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 16:56:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 16:57:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 16:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:57:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 16:57:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:57:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:57:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:57:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:57:10 [DEBUG   ] Finished updating board flags in 1.230 seconds
2019-01-17 16:57:11 [DEBUG   ] Got command RPT from MCS: ref #1198281
2019-01-17 16:57:11 [DEBUG   ] summary = ERROR
2019-01-17 16:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198281  13 58500 61031381 A  ERRORERROR'
2019-01-17 16:57:11 [DEBUG   ] Got command RPT from MCS: ref #1198282
2019-01-17 16:57:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198282  77 58500 61031585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:57:11 [DEBUG   ] Got command RPT from MCS: ref #1198283
2019-01-17 16:57:11 [DEBUG   ] summary = ERROR
2019-01-17 16:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198283  13 58500 61031789 A  ERRORERROR'
2019-01-17 16:57:11 [DEBUG   ] Got command RPT from MCS: ref #1198285
2019-01-17 16:57:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 16:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198285  77 58500 61031981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 16:57:12 [DEBUG   ] Got command RPT from MCS: ref #1198286
2019-01-17 16:57:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 16:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198286  12 58500 61032185 A  ERRORB ff'
2019-01-17 16:57:17 [DEBUG   ] Got command BAM from MCS: ref #1198291
2019-01-17 16:57:17 [INFO    ] Finished processing BAM request
2019-01-17 16:57:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:57:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198291   8 58500 61037025 A  ERROR'
2019-01-17 16:57:17 [DEBUG   ] Got command BAM from MCS: ref #1198292
2019-01-17 16:57:17 [INFO    ] Finished processing BAM request
2019-01-17 16:57:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:57:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198292   8 58500 61037029 A  ERROR'
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:57:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:57:17 [DEBUG   ] spawn_process: at 2019-01-17 16:57:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:57:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 16:57:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 16:57:59 [DEBUG   ] Got command BAM from MCS: ref #1198298
2019-01-17 16:57:59 [INFO    ] Finished processing BAM request
2019-01-17 16:57:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:57:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198298   8 58500 61079029 A  ERROR'
2019-01-17 16:57:59 [DEBUG   ] Got command BAM from MCS: ref #1198297
2019-01-17 16:57:59 [INFO    ] Finished processing BAM request
2019-01-17 16:57:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:57:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198297   8 58500 61079033 A  ERROR'
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 16:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 16:57:59 [DEBUG   ] spawn_process: at 2019-01-17 16:57:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 16:58:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 16:58:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-17 16:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 16:58:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:58:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:58:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:58:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:58:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:58:10 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-01-17 16:58:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 16:58:41 [DEBUG   ] Got command BAM from MCS: ref #1198299
2019-01-17 16:58:41 [INFO    ] Finished processing BAM request
2019-01-17 16:58:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198299   8 58500 61121033 A  ERROR'
2019-01-17 16:58:41 [DEBUG   ] Got command BAM from MCS: ref #1198300
2019-01-17 16:58:41 [INFO    ] Finished processing BAM request
2019-01-17 16:58:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198300   8 58500 61121037 A  ERROR'
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 16:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 16:58:41 [DEBUG   ] spawn_process: at 2019-01-17 16:58:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 16:58:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 16:59:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 16:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 16:59:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 16:59:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 16:59:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:59:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:59:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:59:10 [WARNING ] (13, 1, 'bot')
2019-01-17 16:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 16:59:10 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-17 16:59:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 16:59:23 [DEBUG   ] Got command BAM from MCS: ref #1198302
2019-01-17 16:59:23 [INFO    ] Finished processing BAM request
2019-01-17 16:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198302   8 58500 61163029 A  ERROR'
2019-01-17 16:59:23 [DEBUG   ] Got command BAM from MCS: ref #1198301
2019-01-17 16:59:23 [INFO    ] Finished processing BAM request
2019-01-17 16:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 16:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198301   8 58500 61163033 A  ERROR'
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 16:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 16:59:23 [DEBUG   ] spawn_process: at 2019-01-17 16:59:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 16:59:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 17:00:02 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-17 17:00:05 [DEBUG   ] Got command BAM from MCS: ref #1198303
2019-01-17 17:00:05 [INFO    ] Finished processing BAM request
2019-01-17 17:00:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198303   8 58500 61205033 A  ERROR'
2019-01-17 17:00:05 [DEBUG   ] Got command BAM from MCS: ref #1198304
2019-01-17 17:00:05 [INFO    ] Finished processing BAM request
2019-01-17 17:00:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198304   8 58500 61205037 A  ERROR'
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 17:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 17:00:05 [DEBUG   ] spawn_process: at 2019-01-17 17:00:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 17:00:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-17 17:00:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:00:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:00:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:00:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:00:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:00:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:00:10 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-01-17 17:00:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 17:00:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:00:47 [DEBUG   ] Got command BAM from MCS: ref #1198310
2019-01-17 17:00:47 [INFO    ] Finished processing BAM request
2019-01-17 17:00:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:00:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198310   8 58500 61247025 A  ERROR'
2019-01-17 17:00:47 [DEBUG   ] Got command BAM from MCS: ref #1198309
2019-01-17 17:00:47 [INFO    ] Finished processing BAM request
2019-01-17 17:00:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:00:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198309   8 58500 61247029 A  ERROR'
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:00:47 [DEBUG   ] spawn_process: at 2019-01-17 17:00:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:01:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:01:05 [DEBUG   ] Got command RPT from MCS: ref #1198311
2019-01-17 17:01:05 [DEBUG   ] summary = ERROR
2019-01-17 17:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198311  13 58500 61265697 A  ERRORERROR'
2019-01-17 17:01:05 [DEBUG   ] Got command RPT from MCS: ref #1198312
2019-01-17 17:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198312  77 58500 61265698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-17 17:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-17 17:01:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:01:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:01:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:01:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:01:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:01:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:01:10 [DEBUG   ] Finished updating board flags in 1.280 seconds
2019-01-17 17:01:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:01:29 [DEBUG   ] Got command BAM from MCS: ref #1198328
2019-01-17 17:01:29 [INFO    ] Finished processing BAM request
2019-01-17 17:01:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198328   8 58500 61289033 A  ERROR'
2019-01-17 17:01:29 [DEBUG   ] Got command BAM from MCS: ref #1198329
2019-01-17 17:01:29 [INFO    ] Finished processing BAM request
2019-01-17 17:01:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198329   8 58500 61289037 A  ERROR'
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:01:29 [DEBUG   ] spawn_process: at 2019-01-17 17:01:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:01:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:02:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 17:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:02:11 [DEBUG   ] Got command BAM from MCS: ref #1198330
2019-01-17 17:02:11 [INFO    ] Finished processing BAM request
2019-01-17 17:02:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198330   8 58500 61331033 A  ERROR'
2019-01-17 17:02:11 [DEBUG   ] Got command BAM from MCS: ref #1198331
2019-01-17 17:02:11 [INFO    ] Finished processing BAM request
2019-01-17 17:02:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198331   8 58500 61331037 A  ERROR'
2019-01-17 17:02:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:02:11 [DEBUG   ] Got command RPT from MCS: ref #1198332
2019-01-17 17:02:11 [DEBUG   ] summary = ERROR
2019-01-17 17:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198332  13 58500 61331470 A  ERRORERROR'
2019-01-17 17:02:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:02:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:02:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:02:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:02:11 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-17 17:02:11 [DEBUG   ] Got command RPT from MCS: ref #1198333
2019-01-17 17:02:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198333  77 58500 61331673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:02:11 [DEBUG   ] Got command RPT from MCS: ref #1198334
2019-01-17 17:02:11 [DEBUG   ] summary = ERROR
2019-01-17 17:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198334  13 58500 61331865 A  ERRORERROR'
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 17:02:11 [DEBUG   ] spawn_process: at 2019-01-17 17:02:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 17:02:12 [DEBUG   ] Got command RPT from MCS: ref #1198335
2019-01-17 17:02:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198335  77 58500 61332069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:02:12 [DEBUG   ] Got command RPT from MCS: ref #1198336
2019-01-17 17:02:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198336  12 58500 61332273 A  ERRORB¢ff'
2019-01-17 17:02:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:02:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:02:53 [DEBUG   ] Got command BAM from MCS: ref #1198337
2019-01-17 17:02:53 [INFO    ] Finished processing BAM request
2019-01-17 17:02:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:02:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198337   8 58500 61373029 A  ERROR'
2019-01-17 17:02:53 [DEBUG   ] Got command BAM from MCS: ref #1198338
2019-01-17 17:02:53 [INFO    ] Finished processing BAM request
2019-01-17 17:02:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:02:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198338   8 58500 61373033 A  ERROR'
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:02:53 [DEBUG   ] spawn_process: at 2019-01-17 17:02:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:03:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:03:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 17:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-17 17:03:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:03:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:03:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:03:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:03:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:03:10 [DEBUG   ] Finished updating board flags in 1.178 seconds
2019-01-17 17:03:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:03:35 [DEBUG   ] Got command BAM from MCS: ref #1198344
2019-01-17 17:03:35 [INFO    ] Finished processing BAM request
2019-01-17 17:03:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198344   8 58500 61415029 A  ERROR'
2019-01-17 17:03:35 [DEBUG   ] Got command BAM from MCS: ref #1198343
2019-01-17 17:03:35 [INFO    ] Finished processing BAM request
2019-01-17 17:03:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198343   8 58500 61415033 A  ERROR'
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:03:35 [DEBUG   ] spawn_process: at 2019-01-17 17:03:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:03:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:04:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:04:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-17 17:04:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:04:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:04:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:04:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:04:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:04:10 [DEBUG   ] Finished updating board flags in 1.030 seconds
2019-01-17 17:04:17 [DEBUG   ] Got command BAM from MCS: ref #1198346
2019-01-17 17:04:17 [INFO    ] Finished processing BAM request
2019-01-17 17:04:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198346   8 58500 61457025 A  ERROR'
2019-01-17 17:04:17 [DEBUG   ] Got command BAM from MCS: ref #1198345
2019-01-17 17:04:17 [INFO    ] Finished processing BAM request
2019-01-17 17:04:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198345   8 58500 61457029 A  ERROR'
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:04:17 [DEBUG   ] spawn_process: at 2019-01-17 17:04:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:04:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:04:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:04:59 [DEBUG   ] Got command BAM from MCS: ref #1198347
2019-01-17 17:04:59 [INFO    ] Finished processing BAM request
2019-01-17 17:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198347   8 58500 61499025 A  ERROR'
2019-01-17 17:04:59 [DEBUG   ] Got command BAM from MCS: ref #1198348
2019-01-17 17:04:59 [INFO    ] Finished processing BAM request
2019-01-17 17:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198348   8 58500 61499029 A  ERROR'
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:04:59 [DEBUG   ] spawn_process: at 2019-01-17 17:04:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:05:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:05:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-17 17:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:05:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 17:05:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:05:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:05:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:05:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:05:10 [WARNING ] (13, 1, 'bot')
2019-01-17 17:05:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:05:10 [DEBUG   ] Finished updating board flags in 0.996 seconds
2019-01-17 17:05:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:05:41 [DEBUG   ] Got command BAM from MCS: ref #1198349
2019-01-17 17:05:41 [INFO    ] Finished processing BAM request
2019-01-17 17:05:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:05:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198349   8 58500 61541029 A  ERROR'
2019-01-17 17:05:41 [DEBUG   ] Got command BAM from MCS: ref #1198350
2019-01-17 17:05:41 [INFO    ] Finished processing BAM request
2019-01-17 17:05:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:05:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198350   8 58500 61541033 A  ERROR'
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:05:41 [DEBUG   ] spawn_process: at 2019-01-17 17:05:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:05:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:06:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:06:05 [DEBUG   ] Got command RPT from MCS: ref #1198351
2019-01-17 17:06:05 [DEBUG   ] summary = ERROR
2019-01-17 17:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198351  13 58500 61565697 A  ERRORERROR'
2019-01-17 17:06:05 [DEBUG   ] Got command RPT from MCS: ref #1198352
2019-01-17 17:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198352  77 58500 61565698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:06:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:06:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:06:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:06:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:06:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:06:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:06:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:06:11 [DEBUG   ] Finished updating board flags in 1.343 seconds
2019-01-17 17:06:23 [DEBUG   ] Got command BAM from MCS: ref #1198373
2019-01-17 17:06:23 [INFO    ] Finished processing BAM request
2019-01-17 17:06:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198373   8 58500 61583033 A  ERROR'
2019-01-17 17:06:23 [DEBUG   ] Got command BAM from MCS: ref #1198372
2019-01-17 17:06:23 [INFO    ] Finished processing BAM request
2019-01-17 17:06:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198372   8 58500 61583037 A  ERROR'
2019-01-17 17:06:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:06:23 [DEBUG   ] spawn_process: at 2019-01-17 17:06:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:06:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:07:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:07:05 [DEBUG   ] Got command BAM from MCS: ref #1198376
2019-01-17 17:07:05 [INFO    ] Finished processing BAM request
2019-01-17 17:07:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:07:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198376   8 58500 61625029 A  ERROR'
2019-01-17 17:07:05 [DEBUG   ] Got command BAM from MCS: ref #1198377
2019-01-17 17:07:05 [INFO    ] Finished processing BAM request
2019-01-17 17:07:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:07:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198377   8 58500 61625033 A  ERROR'
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:07:05 [DEBUG   ] spawn_process: at 2019-01-17 17:07:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:07:11 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 17:07:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:07:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:07:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:07:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:07:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:07:11 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-01-17 17:07:11 [DEBUG   ] Got command RPT from MCS: ref #1198378
2019-01-17 17:07:11 [DEBUG   ] summary = ERROR
2019-01-17 17:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198378  13 58500 61631557 A  ERRORERROR'
2019-01-17 17:07:11 [DEBUG   ] Got command RPT from MCS: ref #1198379
2019-01-17 17:07:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198379  77 58500 61631761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:07:11 [DEBUG   ] Got command RPT from MCS: ref #1198380
2019-01-17 17:07:11 [DEBUG   ] summary = ERROR
2019-01-17 17:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198380  13 58500 61631965 A  ERRORERROR'
2019-01-17 17:07:12 [DEBUG   ] Got command RPT from MCS: ref #1198382
2019-01-17 17:07:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:07:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198382  77 58500 61632157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:07:12 [DEBUG   ] Got command RPT from MCS: ref #1198383
2019-01-17 17:07:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:07:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198383  12 58500 61632361 A  ERRORB¡ff'
2019-01-17 17:07:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:07:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:07:47 [DEBUG   ] Got command BAM from MCS: ref #1198389
2019-01-17 17:07:47 [INFO    ] Finished processing BAM request
2019-01-17 17:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198389   8 58500 61667025 A  ERROR'
2019-01-17 17:07:47 [DEBUG   ] Got command BAM from MCS: ref #1198388
2019-01-17 17:07:47 [INFO    ] Finished processing BAM request
2019-01-17 17:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198388   8 58500 61667029 A  ERROR'
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:07:47 [DEBUG   ] spawn_process: at 2019-01-17 17:07:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:08:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:08:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:08:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 17:08:11 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 17:08:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:08:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:08:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:08:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:08:11 [DEBUG   ] Finished updating board flags in 1.075 seconds
2019-01-17 17:08:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:08:29 [DEBUG   ] Got command BAM from MCS: ref #1198391
2019-01-17 17:08:29 [INFO    ] Finished processing BAM request
2019-01-17 17:08:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198391   8 58500 61709029 A  ERROR'
2019-01-17 17:08:29 [DEBUG   ] Got command BAM from MCS: ref #1198390
2019-01-17 17:08:29 [INFO    ] Finished processing BAM request
2019-01-17 17:08:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198390   8 58500 61709033 A  ERROR'
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:08:29 [DEBUG   ] spawn_process: at 2019-01-17 17:08:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:08:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:09:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:09:11 [DEBUG   ] Got command BAM from MCS: ref #1198392
2019-01-17 17:09:11 [INFO    ] Finished processing BAM request
2019-01-17 17:09:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198392   8 58500 61751033 A  ERROR'
2019-01-17 17:09:11 [DEBUG   ] Got command BAM from MCS: ref #1198393
2019-01-17 17:09:11 [INFO    ] Finished processing BAM request
2019-01-17 17:09:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198393   8 58500 61751037 A  ERROR'
2019-01-17 17:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:09:11 [DEBUG   ] spawn_process: at 2019-01-17 17:09:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:09:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 17:09:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-17 17:09:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:09:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:09:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:09:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:09:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:09:12 [DEBUG   ] Finished updating board flags in 1.928 seconds
2019-01-17 17:09:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:09:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:09:53 [DEBUG   ] Got command BAM from MCS: ref #1198399
2019-01-17 17:09:53 [INFO    ] Finished processing BAM request
2019-01-17 17:09:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198399   8 58500 61793025 A  ERROR'
2019-01-17 17:09:53 [DEBUG   ] Got command BAM from MCS: ref #1198398
2019-01-17 17:09:53 [INFO    ] Finished processing BAM request
2019-01-17 17:09:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198398   8 58500 61793029 A  ERROR'
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:09:53 [DEBUG   ] spawn_process: at 2019-01-17 17:09:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:10:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 17:10:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 17:10:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:10:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:10:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:10:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:10:12 [DEBUG   ] Finished updating board flags in 1.897 seconds
2019-01-17 17:10:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:10:35 [DEBUG   ] Got command BAM from MCS: ref #1198401
2019-01-17 17:10:35 [INFO    ] Finished processing BAM request
2019-01-17 17:10:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198401   8 58500 61835033 A  ERROR'
2019-01-17 17:10:35 [DEBUG   ] Got command BAM from MCS: ref #1198400
2019-01-17 17:10:35 [INFO    ] Finished processing BAM request
2019-01-17 17:10:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198400   8 58500 61835037 A  ERROR'
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:10:35 [DEBUG   ] spawn_process: at 2019-01-17 17:10:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:10:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:11:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:11:05 [DEBUG   ] Got command RPT from MCS: ref #1198402
2019-01-17 17:11:05 [DEBUG   ] summary = ERROR
2019-01-17 17:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198402  13 58500 61865709 A  ERRORERROR'
2019-01-17 17:11:05 [DEBUG   ] Got command RPT from MCS: ref #1198403
2019-01-17 17:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198403  77 58500 61865710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:11:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:11:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-01-17 17:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:11:11 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-17 17:11:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:11:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:11:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:11:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:11:11 [DEBUG   ] Finished updating board flags in 1.159 seconds
2019-01-17 17:11:17 [DEBUG   ] Got command BAM from MCS: ref #1198419
2019-01-17 17:11:17 [INFO    ] Finished processing BAM request
2019-01-17 17:11:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198419   8 58500 61877029 A  ERROR'
2019-01-17 17:11:17 [DEBUG   ] Got command BAM from MCS: ref #1198420
2019-01-17 17:11:17 [INFO    ] Finished processing BAM request
2019-01-17 17:11:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198420   8 58500 61877033 A  ERROR'
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:11:17 [DEBUG   ] spawn_process: at 2019-01-17 17:11:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:11:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:11:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:11:59 [DEBUG   ] Got command BAM from MCS: ref #1198422
2019-01-17 17:11:59 [INFO    ] Finished processing BAM request
2019-01-17 17:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198422   8 58500 61919025 A  ERROR'
2019-01-17 17:11:59 [DEBUG   ] Got command BAM from MCS: ref #1198421
2019-01-17 17:11:59 [INFO    ] Finished processing BAM request
2019-01-17 17:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198421   8 58500 61919029 A  ERROR'
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:11:59 [DEBUG   ] spawn_process: at 2019-01-17 17:11:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:12:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 17:12:11 [DEBUG   ] Got command RPT from MCS: ref #1198423
2019-01-17 17:12:11 [DEBUG   ] summary = ERROR
2019-01-17 17:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198423  13 58500 61931645 A  ERRORERROR'
2019-01-17 17:12:11 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:12:11 [DEBUG   ] Got command RPT from MCS: ref #1198424
2019-01-17 17:12:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198424  77 58500 61931841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:12:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:12:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:12:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:12:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:12:11 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-01-17 17:12:12 [DEBUG   ] Got command RPT from MCS: ref #1198425
2019-01-17 17:12:12 [DEBUG   ] summary = ERROR
2019-01-17 17:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198425  13 58500 61932049 A  ERRORERROR'
2019-01-17 17:12:12 [DEBUG   ] Got command RPT from MCS: ref #1198426
2019-01-17 17:12:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198426  77 58500 61932241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:12:12 [DEBUG   ] Got command RPT from MCS: ref #1198427
2019-01-17 17:12:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198427  12 58500 61932445 A  ERRORB ff'
2019-01-17 17:12:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 17:12:41 [DEBUG   ] Got command BAM from MCS: ref #1198432
2019-01-17 17:12:41 [INFO    ] Finished processing BAM request
2019-01-17 17:12:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198432   8 58500 61961033 A  ERROR'
2019-01-17 17:12:41 [DEBUG   ] Got command BAM from MCS: ref #1198433
2019-01-17 17:12:41 [INFO    ] Finished processing BAM request
2019-01-17 17:12:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198433   8 58500 61961037 A  ERROR'
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:12:41 [DEBUG   ] spawn_process: at 2019-01-17 17:12:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:12:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:13:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:13:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:13:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:13:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:13:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:13:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:13:11 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-17 17:13:23 [DEBUG   ] Got command BAM from MCS: ref #1198434
2019-01-17 17:13:23 [INFO    ] Finished processing BAM request
2019-01-17 17:13:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198434   8 58500 62003025 A  ERROR'
2019-01-17 17:13:23 [DEBUG   ] Got command BAM from MCS: ref #1198435
2019-01-17 17:13:23 [INFO    ] Finished processing BAM request
2019-01-17 17:13:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198435   8 58500 62003029 A  ERROR'
2019-01-17 17:13:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:13:23 [DEBUG   ] spawn_process: at 2019-01-17 17:13:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:13:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:14:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:14:05 [DEBUG   ] Got command BAM from MCS: ref #1198436
2019-01-17 17:14:05 [INFO    ] Finished processing BAM request
2019-01-17 17:14:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198436   8 58500 62045029 A  ERROR'
2019-01-17 17:14:05 [DEBUG   ] Got command BAM from MCS: ref #1198437
2019-01-17 17:14:05 [INFO    ] Finished processing BAM request
2019-01-17 17:14:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198437   8 58500 62045033 A  ERROR'
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 17:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 17:14:05 [DEBUG   ] spawn_process: at 2019-01-17 17:14:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 17:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:14:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-17 17:14:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:14:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:14:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:14:11 [WARNING ] (13, 1, 'bot')
2019-01-17 17:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:14:11 [DEBUG   ] Finished updating board flags in 0.971 seconds
2019-01-17 17:14:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:14:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:14:47 [DEBUG   ] Got command BAM from MCS: ref #1198438
2019-01-17 17:14:47 [INFO    ] Finished processing BAM request
2019-01-17 17:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198438   8 58500 62087033 A  ERROR'
2019-01-17 17:14:47 [DEBUG   ] Got command BAM from MCS: ref #1198439
2019-01-17 17:14:47 [INFO    ] Finished processing BAM request
2019-01-17 17:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198439   8 58500 62087037 A  ERROR'
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:14:47 [DEBUG   ] spawn_process: at 2019-01-17 17:14:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:15:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:15:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 17:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 17:15:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:15:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:15:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:15:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:15:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:15:12 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-01-17 17:15:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:15:29 [DEBUG   ] Got command BAM from MCS: ref #1198445
2019-01-17 17:15:29 [INFO    ] Finished processing BAM request
2019-01-17 17:15:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198445   8 58500 62129025 A  ERROR'
2019-01-17 17:15:29 [DEBUG   ] Got command BAM from MCS: ref #1198444
2019-01-17 17:15:29 [INFO    ] Finished processing BAM request
2019-01-17 17:15:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198444   8 58500 62129029 A  ERROR'
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:15:29 [DEBUG   ] spawn_process: at 2019-01-17 17:15:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:15:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:16:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:16:05 [DEBUG   ] Got command RPT from MCS: ref #1198446
2019-01-17 17:16:05 [DEBUG   ] summary = ERROR
2019-01-17 17:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198446  13 58500 62165705 A  ERRORERROR'
2019-01-17 17:16:05 [DEBUG   ] Got command RPT from MCS: ref #1198447
2019-01-17 17:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198447  77 58500 62165706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:16:12 [DEBUG   ] Got command BAM from MCS: ref #1198464
2019-01-17 17:16:12 [INFO    ] Finished processing BAM request
2019-01-17 17:16:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198464   8 58500 62172033 A  ERROR'
2019-01-17 17:16:12 [DEBUG   ] Got command BAM from MCS: ref #1198463
2019-01-17 17:16:12 [INFO    ] Finished processing BAM request
2019-01-17 17:16:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198463   8 58500 62172037 A  ERROR'
2019-01-17 17:16:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:16:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:16:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:16:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:16:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:16:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:16:12 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:16:12 [DEBUG   ] spawn_process: at 2019-01-17 17:16:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:16:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 17:16:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:16:55 [DEBUG   ] Got command BAM from MCS: ref #1198466
2019-01-17 17:16:55 [INFO    ] Finished processing BAM request
2019-01-17 17:16:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198466   8 58500 62215033 A  ERROR'
2019-01-17 17:16:55 [DEBUG   ] Got command BAM from MCS: ref #1198465
2019-01-17 17:16:55 [INFO    ] Finished processing BAM request
2019-01-17 17:16:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198465   8 58500 62215037 A  ERROR'
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:16:55 [DEBUG   ] spawn_process: at 2019-01-17 17:16:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:17:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:17:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:17:11 [DEBUG   ] Got command RPT from MCS: ref #1198469
2019-01-17 17:17:11 [DEBUG   ] summary = ERROR
2019-01-17 17:17:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198469  13 58500 62231725 A  ERRORERROR'
2019-01-17 17:17:11 [DEBUG   ] Got command RPT from MCS: ref #1198470
2019-01-17 17:17:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:17:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198470  77 58500 62231929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:17:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:17:12 [DEBUG   ] Got command RPT from MCS: ref #1198471
2019-01-17 17:17:12 [DEBUG   ] summary = ERROR
2019-01-17 17:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198471  13 58500 62232137 A  ERRORERROR'
2019-01-17 17:17:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 17:17:12 [DEBUG   ] Got command RPT from MCS: ref #1198473
2019-01-17 17:17:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198473  77 58500 62232329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:17:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:17:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:17:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:17:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:17:12 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-01-17 17:17:12 [DEBUG   ] Got command RPT from MCS: ref #1198474
2019-01-17 17:17:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198474  12 58500 62232533 A  ERRORBŸff'
2019-01-17 17:17:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:17:38 [DEBUG   ] Got command BAM from MCS: ref #1198480
2019-01-17 17:17:38 [INFO    ] Finished processing BAM request
2019-01-17 17:17:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198480   8 58500 62258029 A  ERROR'
2019-01-17 17:17:38 [DEBUG   ] Got command BAM from MCS: ref #1198479
2019-01-17 17:17:38 [INFO    ] Finished processing BAM request
2019-01-17 17:17:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198479   8 58500 62258033 A  ERROR'
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 17:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 17:17:38 [DEBUG   ] spawn_process: at 2019-01-17 17:17:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 17:17:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:18:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:18:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:18:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:18:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:18:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:18:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:18:12 [DEBUG   ] Finished updating board flags in 1.078 seconds
2019-01-17 17:18:21 [DEBUG   ] Got command BAM from MCS: ref #1198485
2019-01-17 17:18:21 [INFO    ] Finished processing BAM request
2019-01-17 17:18:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198485   8 58500 62301029 A  ERROR'
2019-01-17 17:18:21 [DEBUG   ] Got command BAM from MCS: ref #1198486
2019-01-17 17:18:21 [INFO    ] Finished processing BAM request
2019-01-17 17:18:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198486   8 58500 62301037 A  ERROR'
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:18:21 [DEBUG   ] spawn_process: at 2019-01-17 17:18:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:18:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:18:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:19:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:19:04 [DEBUG   ] Got command BAM from MCS: ref #1198488
2019-01-17 17:19:04 [INFO    ] Finished processing BAM request
2019-01-17 17:19:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198488   8 58500 62344030 A  ERROR'
2019-01-17 17:19:04 [DEBUG   ] Got command BAM from MCS: ref #1198487
2019-01-17 17:19:04 [INFO    ] Finished processing BAM request
2019-01-17 17:19:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198487   8 58500 62344034 A  ERROR'
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:19:04 [DEBUG   ] spawn_process: at 2019-01-17 17:19:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:19:13 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:19:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:19:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:19:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:19:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:19:13 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-17 17:19:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 17:19:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 17:19:47 [DEBUG   ] Got command BAM from MCS: ref #1198489
2019-01-17 17:19:47 [INFO    ] Finished processing BAM request
2019-01-17 17:19:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198489   8 58500 62387034 A  ERROR'
2019-01-17 17:19:47 [DEBUG   ] Got command BAM from MCS: ref #1198490
2019-01-17 17:19:47 [INFO    ] Finished processing BAM request
2019-01-17 17:19:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198490   8 58500 62387038 A  ERROR'
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:19:47 [DEBUG   ] spawn_process: at 2019-01-17 17:19:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:20:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 17:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:20:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-17 17:20:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:20:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:20:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:20:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:20:12 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-01-17 17:20:23 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-17 17:20:30 [DEBUG   ] Got command BAM from MCS: ref #1198492
2019-01-17 17:20:30 [INFO    ] Finished processing BAM request
2019-01-17 17:20:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198492   8 58500 62430030 A  ERROR'
2019-01-17 17:20:30 [DEBUG   ] Got command BAM from MCS: ref #1198491
2019-01-17 17:20:30 [INFO    ] Finished processing BAM request
2019-01-17 17:20:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198491   8 58500 62430034 A  ERROR'
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:20:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:20:30 [DEBUG   ] spawn_process: at 2019-01-17 17:20:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:20:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 17:21:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 17:21:05 [DEBUG   ] Got command RPT from MCS: ref #1198493
2019-01-17 17:21:05 [DEBUG   ] summary = ERROR
2019-01-17 17:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198493  13 58500 62465709 A  ERRORERROR'
2019-01-17 17:21:05 [DEBUG   ] Got command RPT from MCS: ref #1198494
2019-01-17 17:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198494  77 58500 62465710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:21:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:21:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:21:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:21:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:21:12 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-17 17:21:13 [DEBUG   ] Got command BAM from MCS: ref #1198511
2019-01-17 17:21:13 [INFO    ] Finished processing BAM request
2019-01-17 17:21:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198511   8 58500 62473033 A  ERROR'
2019-01-17 17:21:13 [DEBUG   ] Got command BAM from MCS: ref #1198510
2019-01-17 17:21:13 [INFO    ] Finished processing BAM request
2019-01-17 17:21:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198510   8 58500 62473037 A  ERROR'
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:21:13 [DEBUG   ] spawn_process: at 2019-01-17 17:21:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:21:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 17:21:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:21:56 [DEBUG   ] Got command BAM from MCS: ref #1198516
2019-01-17 17:21:56 [INFO    ] Finished processing BAM request
2019-01-17 17:21:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198516   8 58500 62516025 A  ERROR'
2019-01-17 17:21:56 [DEBUG   ] Got command BAM from MCS: ref #1198517
2019-01-17 17:21:56 [INFO    ] Finished processing BAM request
2019-01-17 17:21:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198517   8 58500 62516029 A  ERROR'
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:21:56 [DEBUG   ] spawn_process: at 2019-01-17 17:21:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:22:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:22:11 [DEBUG   ] Got command RPT from MCS: ref #1198518
2019-01-17 17:22:11 [DEBUG   ] summary = ERROR
2019-01-17 17:22:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198518  13 58500 62531821 A  ERRORERROR'
2019-01-17 17:22:12 [DEBUG   ] Got command RPT from MCS: ref #1198519
2019-01-17 17:22:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198519  77 58500 62532013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:22:12 [DEBUG   ] Got command RPT from MCS: ref #1198520
2019-01-17 17:22:12 [DEBUG   ] summary = ERROR
2019-01-17 17:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198520  13 58500 62532214 A  ERRORERROR'
2019-01-17 17:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:22:12 [DEBUG   ] Got command RPT from MCS: ref #1198521
2019-01-17 17:22:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198521  77 58500 62532417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:22:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:22:12 [DEBUG   ] Got command RPT from MCS: ref #1198522
2019-01-17 17:22:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198522  12 58500 62532622 A  ERRORB™™š'
2019-01-17 17:22:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:22:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:22:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:22:12 [WARNING ] (13, 1, 'bot')
2019-01-17 17:22:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:22:12 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-01-17 17:22:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:22:39 [DEBUG   ] Got command BAM from MCS: ref #1198524
2019-01-17 17:22:39 [INFO    ] Finished processing BAM request
2019-01-17 17:22:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198524   8 58500 62559025 A  ERROR'
2019-01-17 17:22:39 [DEBUG   ] Got command BAM from MCS: ref #1198523
2019-01-17 17:22:39 [INFO    ] Finished processing BAM request
2019-01-17 17:22:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198523   8 58500 62559029 A  ERROR'
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:22:39 [DEBUG   ] spawn_process: at 2019-01-17 17:22:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:22:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:23:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:23:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:23:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 17:23:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:23:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:23:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:23:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:23:13 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-01-17 17:23:22 [DEBUG   ] Got command BAM from MCS: ref #1198525
2019-01-17 17:23:22 [INFO    ] Finished processing BAM request
2019-01-17 17:23:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198525   8 58500 62602033 A  ERROR'
2019-01-17 17:23:22 [DEBUG   ] Got command BAM from MCS: ref #1198526
2019-01-17 17:23:22 [INFO    ] Finished processing BAM request
2019-01-17 17:23:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198526   8 58500 62602037 A  ERROR'
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:23:22 [DEBUG   ] spawn_process: at 2019-01-17 17:23:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:23:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 17:23:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:24:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:24:05 [DEBUG   ] Got command BAM from MCS: ref #1198527
2019-01-17 17:24:05 [INFO    ] Finished processing BAM request
2019-01-17 17:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198527   8 58500 62645033 A  ERROR'
2019-01-17 17:24:05 [DEBUG   ] Got command BAM from MCS: ref #1198528
2019-01-17 17:24:05 [INFO    ] Finished processing BAM request
2019-01-17 17:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198528   8 58500 62645037 A  ERROR'
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:24:05 [DEBUG   ] spawn_process: at 2019-01-17 17:24:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-17 17:24:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:24:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:24:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:24:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:24:13 [DEBUG   ] Finished updating board flags in 1.192 seconds
2019-01-17 17:24:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:24:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:24:48 [DEBUG   ] Got command BAM from MCS: ref #1198533
2019-01-17 17:24:48 [INFO    ] Finished processing BAM request
2019-01-17 17:24:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198533   8 58500 62688033 A  ERROR'
2019-01-17 17:24:48 [DEBUG   ] Got command BAM from MCS: ref #1198534
2019-01-17 17:24:48 [INFO    ] Finished processing BAM request
2019-01-17 17:24:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198534   8 58500 62688037 A  ERROR'
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:24:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:24:48 [DEBUG   ] spawn_process: at 2019-01-17 17:24:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:25:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 17:25:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:25:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:25:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:25:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:25:13 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-01-17 17:25:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:25:31 [DEBUG   ] Got command BAM from MCS: ref #1198536
2019-01-17 17:25:31 [INFO    ] Finished processing BAM request
2019-01-17 17:25:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198536   8 58500 62731025 A  ERROR'
2019-01-17 17:25:31 [DEBUG   ] Got command BAM from MCS: ref #1198535
2019-01-17 17:25:31 [INFO    ] Finished processing BAM request
2019-01-17 17:25:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198535   8 58500 62731029 A  ERROR'
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-17 17:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-17 17:25:31 [DEBUG   ] spawn_process: at 2019-01-17 17:25:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-17 17:25:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:26:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:26:05 [DEBUG   ] Got command RPT from MCS: ref #1198537
2019-01-17 17:26:05 [DEBUG   ] summary = ERROR
2019-01-17 17:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198537  13 58500 62765713 A  ERRORERROR'
2019-01-17 17:26:05 [DEBUG   ] Got command RPT from MCS: ref #1198538
2019-01-17 17:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198538  77 58500 62765714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:26:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:26:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:26:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:26:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:26:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:26:13 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-01-17 17:26:14 [DEBUG   ] Got command BAM from MCS: ref #1198554
2019-01-17 17:26:14 [INFO    ] Finished processing BAM request
2019-01-17 17:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198554   8 58500 62774025 A  ERROR'
2019-01-17 17:26:14 [DEBUG   ] Got command BAM from MCS: ref #1198555
2019-01-17 17:26:14 [INFO    ] Finished processing BAM request
2019-01-17 17:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198555   8 58500 62774029 A  ERROR'
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:26:14 [DEBUG   ] spawn_process: at 2019-01-17 17:26:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:26:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:26:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:26:57 [DEBUG   ] Got command BAM from MCS: ref #1198556
2019-01-17 17:26:57 [INFO    ] Finished processing BAM request
2019-01-17 17:26:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198556   8 58500 62817025 A  ERROR'
2019-01-17 17:26:57 [DEBUG   ] Got command BAM from MCS: ref #1198557
2019-01-17 17:26:57 [INFO    ] Finished processing BAM request
2019-01-17 17:26:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198557   8 58500 62817029 A  ERROR'
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-17 17:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-17 17:26:57 [DEBUG   ] spawn_process: at 2019-01-17 17:26:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-17 17:27:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:27:11 [DEBUG   ] Got command RPT from MCS: ref #1198560
2019-01-17 17:27:11 [DEBUG   ] summary = ERROR
2019-01-17 17:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198560  13 58500 62831897 A  ERRORERROR'
2019-01-17 17:27:12 [DEBUG   ] Got command RPT from MCS: ref #1198561
2019-01-17 17:27:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198561  77 58500 62832101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:27:12 [DEBUG   ] Got command RPT from MCS: ref #1198562
2019-01-17 17:27:12 [DEBUG   ] summary = ERROR
2019-01-17 17:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198562  13 58500 62832305 A  ERRORERROR'
2019-01-17 17:27:12 [DEBUG   ] Got command RPT from MCS: ref #1198564
2019-01-17 17:27:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198564  77 58500 62832509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:27:12 [DEBUG   ] Got command RPT from MCS: ref #1198565
2019-01-17 17:27:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198565  12 58500 62832705 A  ERRORBŸff'
2019-01-17 17:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-17 17:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 17:27:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:27:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:27:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:27:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:27:14 [DEBUG   ] Finished updating board flags in 1.865 seconds
2019-01-17 17:27:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:27:40 [DEBUG   ] Got command BAM from MCS: ref #1198574
2019-01-17 17:27:40 [INFO    ] Finished processing BAM request
2019-01-17 17:27:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198574   8 58500 62860029 A  ERROR'
2019-01-17 17:27:40 [DEBUG   ] Got command BAM from MCS: ref #1198575
2019-01-17 17:27:40 [INFO    ] Finished processing BAM request
2019-01-17 17:27:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198575   8 58500 62860033 A  ERROR'
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:27:40 [DEBUG   ] spawn_process: at 2019-01-17 17:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:27:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:28:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:28:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-17 17:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-17 17:28:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:28:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:28:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:28:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:28:14 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-17 17:28:23 [DEBUG   ] Got command BAM from MCS: ref #1198576
2019-01-17 17:28:23 [INFO    ] Finished processing BAM request
2019-01-17 17:28:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198576   8 58500 62903033 A  ERROR'
2019-01-17 17:28:23 [DEBUG   ] Got command BAM from MCS: ref #1198577
2019-01-17 17:28:23 [INFO    ] Finished processing BAM request
2019-01-17 17:28:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198577   8 58500 62903037 A  ERROR'
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-17 17:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-17 17:28:23 [DEBUG   ] spawn_process: at 2019-01-17 17:28:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-17 17:28:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:28:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:29:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:29:06 [DEBUG   ] Got command BAM from MCS: ref #1198578
2019-01-17 17:29:06 [INFO    ] Finished processing BAM request
2019-01-17 17:29:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198578   8 58500 62946029 A  ERROR'
2019-01-17 17:29:06 [DEBUG   ] Got command BAM from MCS: ref #1198579
2019-01-17 17:29:06 [INFO    ] Finished processing BAM request
2019-01-17 17:29:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198579   8 58500 62946033 A  ERROR'
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:29:06 [DEBUG   ] spawn_process: at 2019-01-17 17:29:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:29:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:29:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:29:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:29:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:29:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:29:13 [WARNING ] (13, 1, 'bot')
2019-01-17 17:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:29:13 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-01-17 17:29:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:29:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:29:50 [DEBUG   ] Got command BAM from MCS: ref #1198581
2019-01-17 17:29:50 [INFO    ] Finished processing BAM request
2019-01-17 17:29:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198581   8 58500 62990033 A  ERROR'
2019-01-17 17:29:50 [DEBUG   ] Got command BAM from MCS: ref #1198580
2019-01-17 17:29:50 [INFO    ] Finished processing BAM request
2019-01-17 17:29:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-17 17:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1198580   8 58500 62990037 A  ERROR'
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-17 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-17 17:29:50 [DEBUG   ] spawn_process: at 2019-01-17 17:29:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-17 17:29:58 [DEBUG   ] Got command STP from MCS: ref #1198582
2019-01-17 17:29:58 [INFO    ] Finished processing BAM request
2019-01-17 17:29:58 [INFO    ] Shutdown the adder chain on beam #2
2019-01-17 17:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1198582   8 58500 62998025 A  ERROR'
2019-01-17 17:29:58 [DEBUG   ] Got command STP from MCS: ref #1198583
2019-01-17 17:29:58 [INFO    ] Finished processing BAM request
2019-01-17 17:29:58 [INFO    ] Shutdown the adder chain on beam #3
2019-01-17 17:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1198583   8 58500 62998029 A  ERROR'
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-17 17:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-17 17:29:58 [DEBUG   ] spawn_process: at 2019-01-17 17:29:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-17 17:30:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:30:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:30:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:30:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:30:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:30:14 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-17 17:30:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:30:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:31:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:31:05 [DEBUG   ] Got command RPT from MCS: ref #1198588
2019-01-17 17:31:05 [DEBUG   ] summary = ERROR
2019-01-17 17:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198588  13 58500 63065713 A  ERRORERROR'
2019-01-17 17:31:05 [DEBUG   ] Got command RPT from MCS: ref #1198589
2019-01-17 17:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198589  77 58500 63065714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:31:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:31:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:31:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:31:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:31:14 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-17 17:31:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:31:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:32:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:32:11 [DEBUG   ] Got command RPT from MCS: ref #1198605
2019-01-17 17:32:11 [DEBUG   ] summary = ERROR
2019-01-17 17:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198605  13 58500 63131985 A  ERRORERROR'
2019-01-17 17:32:12 [DEBUG   ] Got command RPT from MCS: ref #1198606
2019-01-17 17:32:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198606  77 58500 63132189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:32:12 [DEBUG   ] Got command RPT from MCS: ref #1198607
2019-01-17 17:32:12 [DEBUG   ] summary = ERROR
2019-01-17 17:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198607  13 58500 63132393 A  ERRORERROR'
2019-01-17 17:32:12 [DEBUG   ] Got command RPT from MCS: ref #1198608
2019-01-17 17:32:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198608  77 58500 63132585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:32:12 [DEBUG   ] Got command RPT from MCS: ref #1198609
2019-01-17 17:32:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198609  12 58500 63132789 A  ERRORBš™š'
2019-01-17 17:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:32:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:32:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:32:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:32:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:32:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:32:14 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-17 17:32:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:32:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:33:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:33:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:33:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:33:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:33:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:33:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:33:14 [DEBUG   ] Finished updating board flags in 1.262 seconds
2019-01-17 17:33:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 17:33:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:34:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:34:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:34:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:34:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:34:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:34:14 [DEBUG   ] Finished updating board flags in 1.130 seconds
2019-01-17 17:34:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:34:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:35:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:35:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:35:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:35:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:35:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:35:14 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-17 17:35:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:35:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:36:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:36:05 [DEBUG   ] Got command RPT from MCS: ref #1198614
2019-01-17 17:36:05 [DEBUG   ] summary = ERROR
2019-01-17 17:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198614  13 58500 63365713 A  ERRORERROR'
2019-01-17 17:36:05 [DEBUG   ] Got command RPT from MCS: ref #1198615
2019-01-17 17:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198615  77 58500 63365714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:36:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:36:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:36:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:36:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:36:14 [DEBUG   ] Finished updating board flags in 0.987 seconds
2019-01-17 17:36:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:36:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:37:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:37:12 [DEBUG   ] Got command RPT from MCS: ref #1198637
2019-01-17 17:37:12 [DEBUG   ] summary = ERROR
2019-01-17 17:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198637  13 58500 63432065 A  ERRORERROR'
2019-01-17 17:37:12 [DEBUG   ] Got command RPT from MCS: ref #1198638
2019-01-17 17:37:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198638  77 58500 63432269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:37:12 [DEBUG   ] Got command RPT from MCS: ref #1198639
2019-01-17 17:37:12 [DEBUG   ] summary = ERROR
2019-01-17 17:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198639  13 58500 63432473 A  ERRORERROR'
2019-01-17 17:37:12 [DEBUG   ] Got command RPT from MCS: ref #1198641
2019-01-17 17:37:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198641  77 58500 63432665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:37:12 [DEBUG   ] Got command RPT from MCS: ref #1198642
2019-01-17 17:37:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198642  12 58500 63432869 A  ERRORB˜™š'
2019-01-17 17:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:37:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:37:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:37:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:37:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:37:15 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-17 17:37:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:37:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:38:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:38:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:38:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:38:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:38:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:38:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:38:15 [DEBUG   ] Finished updating board flags in 1.857 seconds
2019-01-17 17:38:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:38:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:39:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:39:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:39:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:39:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:39:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:39:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:39:14 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-01-17 17:39:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:39:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:40:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:40:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:40:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:40:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:40:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:40:14 [DEBUG   ] Finished updating board flags in 1.149 seconds
2019-01-17 17:40:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:40:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:41:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:41:05 [DEBUG   ] Got command RPT from MCS: ref #1198651
2019-01-17 17:41:05 [DEBUG   ] summary = ERROR
2019-01-17 17:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198651  13 58500 63665717 A  ERRORERROR'
2019-01-17 17:41:05 [DEBUG   ] Got command RPT from MCS: ref #1198652
2019-01-17 17:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198652  77 58500 63665718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:41:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:41:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:41:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:41:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:41:14 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-01-17 17:41:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:41:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:42:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:42:12 [DEBUG   ] Got command RPT from MCS: ref #1198668
2019-01-17 17:42:12 [DEBUG   ] summary = ERROR
2019-01-17 17:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198668  13 58500 63732153 A  ERRORERROR'
2019-01-17 17:42:12 [DEBUG   ] Got command RPT from MCS: ref #1198669
2019-01-17 17:42:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198669  77 58500 63732345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:42:12 [DEBUG   ] Got command RPT from MCS: ref #1198670
2019-01-17 17:42:12 [DEBUG   ] summary = ERROR
2019-01-17 17:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198670  13 58500 63732549 A  ERRORERROR'
2019-01-17 17:42:12 [DEBUG   ] Got command RPT from MCS: ref #1198671
2019-01-17 17:42:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198671  77 58500 63732753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:42:12 [DEBUG   ] Got command RPT from MCS: ref #1198672
2019-01-17 17:42:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198672  12 58500 63732957 A  ERRORB–™š'
2019-01-17 17:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:42:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:42:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:42:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:42:14 [WARNING ] (13, 1, 'bot')
2019-01-17 17:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:42:14 [DEBUG   ] Finished updating board flags in 0.947 seconds
2019-01-17 17:42:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:42:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:43:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:43:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:43:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:43:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:43:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:43:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:43:15 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-17 17:43:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:43:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:44:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:44:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:44:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:44:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:44:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:44:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:44:15 [DEBUG   ] Finished updating board flags in 1.338 seconds
2019-01-17 17:44:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:44:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:45:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 17:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:45:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:45:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:45:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:45:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:45:15 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-01-17 17:45:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 17:45:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 17:46:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 17:46:05 [DEBUG   ] Got command RPT from MCS: ref #1198681
2019-01-17 17:46:05 [DEBUG   ] summary = ERROR
2019-01-17 17:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198681  13 58500 63965713 A  ERRORERROR'
2019-01-17 17:46:05 [DEBUG   ] Got command RPT from MCS: ref #1198682
2019-01-17 17:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198682  77 58500 63965714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:46:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:46:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:46:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:46:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:46:15 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-01-17 17:46:24 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-17 17:46:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 17:47:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 17:47:12 [DEBUG   ] Got command RPT from MCS: ref #1198700
2019-01-17 17:47:12 [DEBUG   ] summary = ERROR
2019-01-17 17:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198700  13 58500 64032225 A  ERRORERROR'
2019-01-17 17:47:12 [DEBUG   ] Got command RPT from MCS: ref #1198701
2019-01-17 17:47:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198701  77 58500 64032429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:47:12 [DEBUG   ] Got command RPT from MCS: ref #1198702
2019-01-17 17:47:12 [DEBUG   ] summary = ERROR
2019-01-17 17:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198702  13 58500 64032633 A  ERRORERROR'
2019-01-17 17:47:12 [DEBUG   ] Got command RPT from MCS: ref #1198704
2019-01-17 17:47:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198704  77 58500 64032825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:47:13 [DEBUG   ] Got command RPT from MCS: ref #1198705
2019-01-17 17:47:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198705  12 58500 64033029 A  ERRORB”™š'
2019-01-17 17:47:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2019-01-17 17:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:47:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:47:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:47:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:47:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:47:15 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-17 17:47:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:47:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:48:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:48:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:48:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:48:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:48:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:48:15 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-17 17:48:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:48:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:49:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:49:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 17:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:49:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:49:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:49:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:49:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:49:15 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-01-17 17:49:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 17:49:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:50:00 [DEBUG   ] Got command TBN from MCS: ref #1198714
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-17 17:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1198714   8 58500 64200505 A  ERROR'
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547747402']
2019-01-17 17:50:00 [DEBUG   ] spawn_process: at 2019-01-17 17:50:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547747402']
2019-01-17 17:50:00 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-17 17:50:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 17:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:50:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:50:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:50:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:50:15 [WARNING ] (13, 1, 'bot')
2019-01-17 17:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:50:15 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-17 17:50:25 [DEBUG   ] Finished updating ant stats in 1.068 seconds
2019-01-17 17:50:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 17:51:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 17:51:05 [DEBUG   ] Got command RPT from MCS: ref #1198715
2019-01-17 17:51:05 [DEBUG   ] summary = ERROR
2019-01-17 17:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198715  13 58500 64265713 A  ERRORERROR'
2019-01-17 17:51:05 [DEBUG   ] Got command RPT from MCS: ref #1198716
2019-01-17 17:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198716  77 58500 64265714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:51:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:51:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:51:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:51:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:51:16 [DEBUG   ] Finished updating board flags in 2.254 seconds
2019-01-17 17:51:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 17:51:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 17:52:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 17:52:12 [DEBUG   ] Got command RPT from MCS: ref #1198736
2019-01-17 17:52:12 [DEBUG   ] summary = ERROR
2019-01-17 17:52:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198736  13 58500 64332305 A  ERRORERROR'
2019-01-17 17:52:12 [DEBUG   ] Got command RPT from MCS: ref #1198737
2019-01-17 17:52:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:52:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198737  77 58500 64332509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:52:12 [DEBUG   ] Got command RPT from MCS: ref #1198738
2019-01-17 17:52:12 [DEBUG   ] summary = ERROR
2019-01-17 17:52:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198738  13 58500 64332713 A  ERRORERROR'
2019-01-17 17:52:12 [DEBUG   ] Got command RPT from MCS: ref #1198739
2019-01-17 17:52:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:52:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198739  77 58500 64332905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:52:13 [DEBUG   ] Got command RPT from MCS: ref #1198740
2019-01-17 17:52:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198740  12 58500 64333109 A  ERRORB—™š'
2019-01-17 17:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:52:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:52:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:52:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:52:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:52:16 [DEBUG   ] Finished updating board flags in 2.150 seconds
2019-01-17 17:52:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:52:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 17:53:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 17:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:53:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:53:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:53:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:53:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:53:16 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-17 17:53:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 17:53:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 17:54:06 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2019-01-17 17:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:54:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 17:54:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:54:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:54:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:54:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:54:16 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-17 17:54:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 17:54:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 17:55:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 17:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:55:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:55:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:55:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:55:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:55:16 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-17 17:55:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 17:55:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 17:56:05 [DEBUG   ] Got command RPT from MCS: ref #1198753
2019-01-17 17:56:05 [DEBUG   ] summary = ERROR
2019-01-17 17:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198753  13 58500 64565717 A  ERRORERROR'
2019-01-17 17:56:05 [DEBUG   ] Got command RPT from MCS: ref #1198754
2019-01-17 17:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198754  77 58500 64565718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:56:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:56:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:56:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:56:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:56:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:56:16 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-17 17:56:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 17:56:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 17:57:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 17:57:12 [DEBUG   ] Got command RPT from MCS: ref #1198775
2019-01-17 17:57:12 [DEBUG   ] summary = ERROR
2019-01-17 17:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198775  13 58500 64632385 A  ERRORERROR'
2019-01-17 17:57:12 [DEBUG   ] Got command RPT from MCS: ref #1198776
2019-01-17 17:57:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198776  77 58500 64632589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:57:12 [DEBUG   ] Got command RPT from MCS: ref #1198777
2019-01-17 17:57:12 [DEBUG   ] summary = ERROR
2019-01-17 17:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198777  13 58500 64632793 A  ERRORERROR'
2019-01-17 17:57:12 [DEBUG   ] Got command RPT from MCS: ref #1198779
2019-01-17 17:57:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 17:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198779  77 58500 64632997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 17:57:13 [DEBUG   ] Got command RPT from MCS: ref #1198780
2019-01-17 17:57:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 17:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198780  12 58500 64633189 A  ERRORB—™š'
2019-01-17 17:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:57:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:57:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:57:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:57:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:57:16 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-01-17 17:57:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:57:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 17:58:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 17:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:58:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 17:58:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:58:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:58:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:58:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:58:16 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-17 17:58:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 17:58:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 17:59:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 17:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 17:59:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:59:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:59:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:59:16 [WARNING ] (13, 1, 'bot')
2019-01-17 17:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 17:59:16 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-17 17:59:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 17:59:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 18:00:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 18:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:00:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 18:00:16 [WARNING ] (13, 1, 'bot')
2019-01-17 18:00:16 [WARNING ] (13, 1, 'bot')
2019-01-17 18:00:16 [WARNING ] (13, 1, 'bot')
2019-01-17 18:00:16 [WARNING ] (13, 1, 'bot')
2019-01-17 18:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:00:16 [DEBUG   ] Finished updating board flags in 1.479 seconds
2019-01-17 18:00:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 18:00:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 18:01:05 [DEBUG   ] Got command RPT from MCS: ref #1198793
2019-01-17 18:01:05 [DEBUG   ] summary = ERROR
2019-01-17 18:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198793  13 58500 64865721 A  ERRORERROR'
2019-01-17 18:01:05 [DEBUG   ] Got command RPT from MCS: ref #1198794
2019-01-17 18:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198794  77 58500 64865722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:01:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 18:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:01:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:01:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:01:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:01:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:01:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:01:17 [DEBUG   ] Finished updating board flags in 2.254 seconds
2019-01-17 18:01:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 18:01:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 18:02:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 18:02:12 [DEBUG   ] Got command RPT from MCS: ref #1198810
2019-01-17 18:02:12 [DEBUG   ] summary = ERROR
2019-01-17 18:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198810  13 58500 64932465 A  ERRORERROR'
2019-01-17 18:02:12 [DEBUG   ] Got command RPT from MCS: ref #1198811
2019-01-17 18:02:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198811  77 58500 64932669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:02:12 [DEBUG   ] Got command RPT from MCS: ref #1198812
2019-01-17 18:02:12 [DEBUG   ] summary = ERROR
2019-01-17 18:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198812  13 58500 64932873 A  ERRORERROR'
2019-01-17 18:02:13 [DEBUG   ] Got command RPT from MCS: ref #1198813
2019-01-17 18:02:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198813  77 58500 64933077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:02:13 [DEBUG   ] Got command RPT from MCS: ref #1198814
2019-01-17 18:02:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198814  12 58500 64933269 A  ERRORB•™š'
2019-01-17 18:02:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:02:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:02:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:02:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:02:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:02:17 [DEBUG   ] Finished updating board flags in 2.170 seconds
2019-01-17 18:02:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:02:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:03:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 18:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:03:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:03:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:03:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:03:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:03:17 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-17 18:03:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:03:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 18:04:07 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 18:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:04:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:04:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:04:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:04:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:04:17 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-17 18:04:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 18:04:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 18:05:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 18:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:05:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:05:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:05:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:05:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:05:17 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-01-17 18:05:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 18:05:47 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-17 18:06:05 [DEBUG   ] Got command RPT from MCS: ref #1198819
2019-01-17 18:06:05 [DEBUG   ] summary = ERROR
2019-01-17 18:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198819  13 58500 65165717 A  ERRORERROR'
2019-01-17 18:06:05 [DEBUG   ] Got command RPT from MCS: ref #1198820
2019-01-17 18:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198820  77 58500 65165718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:06:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 18:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:06:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:06:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:06:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:06:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:06:17 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-17 18:06:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 18:06:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 18:07:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 18:07:12 [DEBUG   ] Got command RPT from MCS: ref #1198842
2019-01-17 18:07:12 [DEBUG   ] summary = ERROR
2019-01-17 18:07:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198842  13 58500 65232553 A  ERRORERROR'
2019-01-17 18:07:12 [DEBUG   ] Got command RPT from MCS: ref #1198843
2019-01-17 18:07:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:07:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198843  77 58500 65232745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:07:12 [DEBUG   ] Got command RPT from MCS: ref #1198844
2019-01-17 18:07:12 [DEBUG   ] summary = ERROR
2019-01-17 18:07:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198844  13 58500 65232949 A  ERRORERROR'
2019-01-17 18:07:13 [DEBUG   ] Got command RPT from MCS: ref #1198846
2019-01-17 18:07:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:07:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198846  77 58500 65233153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:07:13 [DEBUG   ] Got command RPT from MCS: ref #1198847
2019-01-17 18:07:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:07:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198847  12 58500 65233357 A  ERRORB•™š'
2019-01-17 18:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:07:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:07:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:07:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:07:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:07:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:07:17 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-17 18:07:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 18:07:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 18:08:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 18:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:08:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:08:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:08:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:08:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:08:17 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-17 18:08:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:08:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:09:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 18:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:09:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:09:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:09:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:09:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:09:17 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-17 18:09:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 18:09:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 18:10:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 18:10:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 18:10:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:10:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 18:10:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:10:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:10:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:10:17 [WARNING ] (13, 1, 'bot')
2019-01-17 18:10:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:10:17 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-17 18:10:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 18:10:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 18:11:05 [DEBUG   ] Got command RPT from MCS: ref #1198856
2019-01-17 18:11:05 [DEBUG   ] summary = ERROR
2019-01-17 18:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198856  13 58500 65465713 A  ERRORERROR'
2019-01-17 18:11:05 [DEBUG   ] Got command RPT from MCS: ref #1198857
2019-01-17 18:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198857  77 58500 65465714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:11:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 18:11:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:11:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 18:11:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:11:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:11:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:11:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:11:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:11:18 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-01-17 18:11:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 18:11:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 18:12:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:12:12 [DEBUG   ] Got command RPT from MCS: ref #1198873
2019-01-17 18:12:12 [DEBUG   ] summary = ERROR
2019-01-17 18:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198873  13 58500 65532633 A  ERRORERROR'
2019-01-17 18:12:12 [DEBUG   ] Got command RPT from MCS: ref #1198874
2019-01-17 18:12:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198874  77 58500 65532825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:12:13 [DEBUG   ] Got command RPT from MCS: ref #1198875
2019-01-17 18:12:13 [DEBUG   ] summary = ERROR
2019-01-17 18:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198875  13 58500 65533029 A  ERRORERROR'
2019-01-17 18:12:13 [DEBUG   ] Got command RPT from MCS: ref #1198876
2019-01-17 18:12:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198876  77 58500 65533233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:12:13 [DEBUG   ] Got command RPT from MCS: ref #1198877
2019-01-17 18:12:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198877  12 58500 65533437 A  ERRORB—™š'
2019-01-17 18:12:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:12:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:12:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:12:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:12:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:12:18 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-17 18:12:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:12:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 18:13:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 18:13:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 18:13:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:13:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:13:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:13:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:13:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:13:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:13:18 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-01-17 18:13:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:13:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:14:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:14:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 18:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:14:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:14:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:14:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:14:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:14:18 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-17 18:14:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 18:14:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 18:15:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 18:15:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:15:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:15:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:15:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:15:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:15:18 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-01-17 18:15:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 18:15:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 18:16:05 [DEBUG   ] Got command RPT from MCS: ref #1198886
2019-01-17 18:16:05 [DEBUG   ] summary = ERROR
2019-01-17 18:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198886  13 58500 65765725 A  ERRORERROR'
2019-01-17 18:16:05 [DEBUG   ] Got command RPT from MCS: ref #1198887
2019-01-17 18:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198887  77 58500 65765726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:16:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 18:16:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:16:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:16:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:16:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:16:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:16:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:16:18 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-17 18:16:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 18:16:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 18:17:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:17:12 [DEBUG   ] Got command RPT from MCS: ref #1198905
2019-01-17 18:17:12 [DEBUG   ] summary = ERROR
2019-01-17 18:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198905  13 58500 65832705 A  ERRORERROR'
2019-01-17 18:17:12 [DEBUG   ] Got command RPT from MCS: ref #1198906
2019-01-17 18:17:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198906  77 58500 65832909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:17:13 [DEBUG   ] Got command RPT from MCS: ref #1198907
2019-01-17 18:17:13 [DEBUG   ] summary = ERROR
2019-01-17 18:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198907  13 58500 65833113 A  ERRORERROR'
2019-01-17 18:17:13 [DEBUG   ] Got command RPT from MCS: ref #1198909
2019-01-17 18:17:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198909  77 58500 65833305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:17:13 [DEBUG   ] Got command RPT from MCS: ref #1198910
2019-01-17 18:17:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198910  12 58500 65833509 A  ERRORB—™š'
2019-01-17 18:17:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:17:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:17:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:17:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:17:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:17:18 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-17 18:17:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 18:17:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 18:18:10 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2019-01-17 18:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:18:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:18:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:18:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:18:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:18:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:18:18 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-17 18:18:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 18:18:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:19:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 18:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:19:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:19:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:19:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:19:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:19:18 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-17 18:19:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 18:19:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 18:20:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 18:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:20:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:20:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:20:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:20:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:20:18 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-01-17 18:20:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 18:20:51 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 18:21:05 [DEBUG   ] Got command RPT from MCS: ref #1198919
2019-01-17 18:21:05 [DEBUG   ] summary = ERROR
2019-01-17 18:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198919  13 58500 66065717 A  ERRORERROR'
2019-01-17 18:21:05 [DEBUG   ] Got command RPT from MCS: ref #1198920
2019-01-17 18:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198920  77 58500 66065718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:21:11 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 18:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:21:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:21:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:21:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:21:18 [WARNING ] (13, 1, 'bot')
2019-01-17 18:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:21:18 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-17 18:21:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 18:21:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 18:22:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 18:22:12 [DEBUG   ] Got command RPT from MCS: ref #1198940
2019-01-17 18:22:12 [DEBUG   ] summary = ERROR
2019-01-17 18:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198940  13 58500 66132785 A  ERRORERROR'
2019-01-17 18:22:12 [DEBUG   ] Got command RPT from MCS: ref #1198941
2019-01-17 18:22:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198941  77 58500 66132989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:22:13 [DEBUG   ] Got command RPT from MCS: ref #1198942
2019-01-17 18:22:13 [DEBUG   ] summary = ERROR
2019-01-17 18:22:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198942  13 58500 66133193 A  ERRORERROR'
2019-01-17 18:22:13 [DEBUG   ] Got command RPT from MCS: ref #1198943
2019-01-17 18:22:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:22:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198943  77 58500 66133385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:22:13 [DEBUG   ] Got command RPT from MCS: ref #1198944
2019-01-17 18:22:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:22:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198944  12 58500 66133589 A  ERRORB–™š'
2019-01-17 18:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:22:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:22:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:22:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:22:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:22:19 [DEBUG   ] Finished updating board flags in 2.068 seconds
2019-01-17 18:22:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:22:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 18:23:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:23:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 18:23:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:23:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:23:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:23:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:23:19 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-01-17 18:23:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 18:23:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 18:24:12 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2019-01-17 18:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:24:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:24:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:24:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:24:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:24:19 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-17 18:24:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 18:24:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-17 18:25:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 18:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:25:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:25:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:25:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:25:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:25:19 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-17 18:25:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 18:25:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 18:26:05 [DEBUG   ] Got command RPT from MCS: ref #1198949
2019-01-17 18:26:05 [DEBUG   ] summary = ERROR
2019-01-17 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198949  13 58500 66365725 A  ERRORERROR'
2019-01-17 18:26:05 [DEBUG   ] Got command RPT from MCS: ref #1198950
2019-01-17 18:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198950  77 58500 66365726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:26:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 18:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:26:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:26:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:26:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:26:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:26:19 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-17 18:26:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 18:26:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:27:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:27:12 [DEBUG   ] Got command RPT from MCS: ref #1198968
2019-01-17 18:27:12 [DEBUG   ] summary = ERROR
2019-01-17 18:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198968  13 58500 66432873 A  ERRORERROR'
2019-01-17 18:27:13 [DEBUG   ] Got command RPT from MCS: ref #1198969
2019-01-17 18:27:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198969  77 58500 66433065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:27:13 [DEBUG   ] Got command RPT from MCS: ref #1198970
2019-01-17 18:27:13 [DEBUG   ] summary = ERROR
2019-01-17 18:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198970  13 58500 66433269 A  ERRORERROR'
2019-01-17 18:27:13 [DEBUG   ] Got command RPT from MCS: ref #1198972
2019-01-17 18:27:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198972  77 58500 66433473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:27:13 [DEBUG   ] Got command RPT from MCS: ref #1198973
2019-01-17 18:27:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198973  12 58500 66433665 A  ERRORB•™š'
2019-01-17 18:27:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:27:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:27:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:27:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:27:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:27:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:27:19 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-17 18:27:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:27:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 18:28:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:28:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:28:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:28:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:28:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:28:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:28:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:28:19 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-17 18:28:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:28:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 18:29:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 18:29:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:29:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:29:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:29:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:29:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:29:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:29:19 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-17 18:29:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 18:29:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 18:30:12 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 18:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:30:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 18:30:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:30:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:30:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:30:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:30:19 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-17 18:30:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 18:30:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 18:31:05 [DEBUG   ] Got command RPT from MCS: ref #1198986
2019-01-17 18:31:05 [DEBUG   ] summary = ERROR
2019-01-17 18:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198986  13 58500 66665721 A  ERRORERROR'
2019-01-17 18:31:05 [DEBUG   ] Got command RPT from MCS: ref #1198987
2019-01-17 18:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1198987  77 58500 66665722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:31:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 18:31:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 18:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:31:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:31:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:31:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:31:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:31:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:31:19 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-17 18:31:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 18:31:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 18:32:12 [DEBUG   ] Got command RPT from MCS: ref #1199003
2019-01-17 18:32:12 [DEBUG   ] summary = ERROR
2019-01-17 18:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199003  13 58500 66732941 A  ERRORERROR'
2019-01-17 18:32:13 [DEBUG   ] Got command RPT from MCS: ref #1199004
2019-01-17 18:32:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:32:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199004  77 58500 66733145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:32:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 18:32:13 [DEBUG   ] Got command RPT from MCS: ref #1199005
2019-01-17 18:32:13 [DEBUG   ] summary = ERROR
2019-01-17 18:32:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199005  13 58500 66733349 A  ERRORERROR'
2019-01-17 18:32:13 [DEBUG   ] Got command RPT from MCS: ref #1199006
2019-01-17 18:32:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:32:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199006  77 58500 66733553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:32:13 [DEBUG   ] Got command RPT from MCS: ref #1199007
2019-01-17 18:32:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:32:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199007  12 58500 66733745 A  ERRORB•™š'
2019-01-17 18:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:32:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 18:32:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:32:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:32:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:32:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:32:19 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-17 18:32:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 18:32:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 18:33:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:33:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:33:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:33:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:33:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:33:19 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-17 18:33:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:33:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:34:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 18:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:34:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:34:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:34:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:34:19 [WARNING ] (13, 1, 'bot')
2019-01-17 18:34:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:34:19 [DEBUG   ] Finished updating board flags in 1.525 seconds
2019-01-17 18:34:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:34:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:35:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:35:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:35:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:35:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:35:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:35:20 [DEBUG   ] Finished updating board flags in 2.243 seconds
2019-01-17 18:35:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 18:35:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:36:05 [DEBUG   ] Got command RPT from MCS: ref #1199012
2019-01-17 18:36:05 [DEBUG   ] summary = ERROR
2019-01-17 18:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199012  13 58500 66965725 A  ERRORERROR'
2019-01-17 18:36:05 [DEBUG   ] Got command RPT from MCS: ref #1199013
2019-01-17 18:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199013  77 58500 66965726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:36:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:36:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 18:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:36:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:36:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:36:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:36:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:36:20 [DEBUG   ] Finished updating board flags in 2.119 seconds
2019-01-17 18:36:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:36:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 18:37:13 [DEBUG   ] Got command RPT from MCS: ref #1199035
2019-01-17 18:37:13 [DEBUG   ] summary = ERROR
2019-01-17 18:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199035  13 58500 67033029 A  ERRORERROR'
2019-01-17 18:37:13 [DEBUG   ] Got command RPT from MCS: ref #1199036
2019-01-17 18:37:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199036  77 58500 67033233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:37:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:37:13 [DEBUG   ] Got command RPT from MCS: ref #1199037
2019-01-17 18:37:13 [DEBUG   ] summary = ERROR
2019-01-17 18:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199037  13 58500 67033429 A  ERRORERROR'
2019-01-17 18:37:13 [DEBUG   ] Got command RPT from MCS: ref #1199039
2019-01-17 18:37:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199039  77 58500 67033633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:37:13 [DEBUG   ] Got command RPT from MCS: ref #1199040
2019-01-17 18:37:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199040  12 58500 67033825 A  ERRORB—™š'
2019-01-17 18:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:37:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:37:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:37:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:37:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:37:20 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-17 18:37:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:37:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:38:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 18:38:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 18:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:38:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:38:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:38:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:38:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:38:20 [DEBUG   ] Finished updating board flags in 1.958 seconds
2019-01-17 18:38:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:38:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:39:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 18:39:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:39:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:39:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:39:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:39:20 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-17 18:39:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 18:39:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:40:13 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2019-01-17 18:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:40:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:40:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:40:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:40:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:40:20 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-17 18:40:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 18:40:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 18:41:05 [DEBUG   ] Got command RPT from MCS: ref #1199049
2019-01-17 18:41:05 [DEBUG   ] summary = ERROR
2019-01-17 18:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199049  13 58500 67265721 A  ERRORERROR'
2019-01-17 18:41:05 [DEBUG   ] Got command RPT from MCS: ref #1199050
2019-01-17 18:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199050  77 58500 67265722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:41:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 18:41:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 18:41:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:41:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:41:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:41:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:41:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:41:20 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-17 18:41:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 18:41:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 18:42:13 [DEBUG   ] Got command RPT from MCS: ref #1199066
2019-01-17 18:42:13 [DEBUG   ] summary = ERROR
2019-01-17 18:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199066  13 58500 67333113 A  ERRORERROR'
2019-01-17 18:42:13 [DEBUG   ] Got command RPT from MCS: ref #1199067
2019-01-17 18:42:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199067  77 58500 67333305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:42:13 [DEBUG   ] Got command RPT from MCS: ref #1199068
2019-01-17 18:42:13 [DEBUG   ] summary = ERROR
2019-01-17 18:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199068  13 58500 67333509 A  ERRORERROR'
2019-01-17 18:42:13 [DEBUG   ] Got command RPT from MCS: ref #1199069
2019-01-17 18:42:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199069  77 58500 67333709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:42:13 [DEBUG   ] Got command RPT from MCS: ref #1199070
2019-01-17 18:42:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199070  12 58500 67333913 A  ERRORB–™š'
2019-01-17 18:42:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:42:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:42:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:42:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:42:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:42:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:42:20 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-17 18:42:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:42:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:43:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 18:43:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:43:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:43:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:43:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:43:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:43:20 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-17 18:43:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 18:43:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:44:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:44:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:44:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:44:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:44:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:44:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:44:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:44:20 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-17 18:44:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 18:44:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 18:45:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 18:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:45:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:45:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:45:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:45:20 [WARNING ] (13, 1, 'bot')
2019-01-17 18:45:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:45:20 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-17 18:45:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 18:45:54 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-17 18:46:05 [DEBUG   ] Got command RPT from MCS: ref #1199079
2019-01-17 18:46:05 [DEBUG   ] summary = ERROR
2019-01-17 18:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199079  13 58500 67565729 A  ERRORERROR'
2019-01-17 18:46:05 [DEBUG   ] Got command RPT from MCS: ref #1199080
2019-01-17 18:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199080  77 58500 67565730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:46:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 18:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:46:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:46:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:46:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:46:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:46:21 [DEBUG   ] Finished updating board flags in 2.053 seconds
2019-01-17 18:46:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 18:46:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 18:47:13 [DEBUG   ] Got command RPT from MCS: ref #1199098
2019-01-17 18:47:13 [DEBUG   ] summary = ERROR
2019-01-17 18:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199098  13 58500 67633193 A  ERRORERROR'
2019-01-17 18:47:13 [DEBUG   ] Got command RPT from MCS: ref #1199099
2019-01-17 18:47:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199099  77 58500 67633385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:47:13 [DEBUG   ] Got command RPT from MCS: ref #1199100
2019-01-17 18:47:13 [DEBUG   ] summary = ERROR
2019-01-17 18:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199100  13 58500 67633589 A  ERRORERROR'
2019-01-17 18:47:13 [DEBUG   ] Got command RPT from MCS: ref #1199102
2019-01-17 18:47:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199102  77 58500 67633793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:47:13 [DEBUG   ] Got command RPT from MCS: ref #1199103
2019-01-17 18:47:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199103  12 58500 67633997 A  ERRORB•™š'
2019-01-17 18:47:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 18:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:47:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:47:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:47:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:47:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:47:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:47:21 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-17 18:47:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 18:47:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 18:48:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 18:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:48:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:48:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:48:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:48:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:48:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:48:21 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-17 18:48:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 18:48:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:49:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 18:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:49:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:49:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:49:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:49:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:49:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:49:21 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-17 18:49:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:49:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 18:50:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 18:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 18:50:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:50:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:50:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:50:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:50:21 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-17 18:50:35 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-17 18:50:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 18:51:05 [DEBUG   ] Got command RPT from MCS: ref #1199112
2019-01-17 18:51:05 [DEBUG   ] summary = ERROR
2019-01-17 18:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199112  13 58500 67865725 A  ERRORERROR'
2019-01-17 18:51:05 [DEBUG   ] Got command RPT from MCS: ref #1199113
2019-01-17 18:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199113  77 58500 67865726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:51:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 18:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:51:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:51:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:51:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:51:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:51:21 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-17 18:51:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 18:51:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 18:52:13 [DEBUG   ] Got command RPT from MCS: ref #1199133
2019-01-17 18:52:13 [DEBUG   ] summary = ERROR
2019-01-17 18:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199133  13 58500 67933269 A  ERRORERROR'
2019-01-17 18:52:13 [DEBUG   ] Got command RPT from MCS: ref #1199134
2019-01-17 18:52:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199134  77 58500 67933473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:52:13 [DEBUG   ] Got command RPT from MCS: ref #1199135
2019-01-17 18:52:13 [DEBUG   ] summary = ERROR
2019-01-17 18:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199135  13 58500 67933677 A  ERRORERROR'
2019-01-17 18:52:13 [DEBUG   ] Got command RPT from MCS: ref #1199136
2019-01-17 18:52:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199136  77 58500 67933869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:52:14 [DEBUG   ] Got command RPT from MCS: ref #1199137
2019-01-17 18:52:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199137  12 58500 67934073 A  ERRORB•™š'
2019-01-17 18:52:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 18:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:52:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 18:52:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:52:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:52:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:52:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:52:21 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-17 18:52:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 18:52:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 18:53:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:53:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:53:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:53:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:53:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:53:21 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-17 18:53:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 18:53:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 18:54:11 [DEBUG   ] Got command TBW from MCS: ref #1199139
2019-01-17 18:54:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-17 18:54:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1199139   8 58500 68051781 A  ERROR'
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-17 18:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-17 18:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-17 18:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-17 18:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-17 18:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-17 18:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-17 18:54:15 [DEBUG   ] spawn_process: at 2019-01-17 18:54:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-17 18:54:15 [INFO    ] Finished spawning TBW
2019-01-17 18:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:54:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:54:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:54:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:54:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:54:21 [DEBUG   ] Finished updating board flags in 1.323 seconds
2019-01-17 18:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:55:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:55:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:55:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:55:21 [WARNING ] (13, 1, 'bot')
2019-01-17 18:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:55:21 [DEBUG   ] Finished updating board flags in 1.276 seconds
2019-01-17 18:56:03 [INFO    ] __waitForTBW - TBW finished in 108.503 s
2019-01-17 18:56:04 [DEBUG   ] Finished updating ant stats in 0.471 seconds
2019-01-17 18:56:04 [INFO    ] Started antennas statistics background thread
2019-01-17 18:56:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547751366']
2019-01-17 18:56:04 [DEBUG   ] spawn_process: at 2019-01-17 18:56:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547751366']
2019-01-17 18:56:04 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-17 18:56:05 [DEBUG   ] Got command RPT from MCS: ref #1199148
2019-01-17 18:56:05 [DEBUG   ] summary = ERROR
2019-01-17 18:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199148  13 58500 68165725 A  ERRORERROR'
2019-01-17 18:56:05 [DEBUG   ] Got command RPT from MCS: ref #1199149
2019-01-17 18:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199149  77 58500 68165726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:56:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:56:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:56:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:56:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:56:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:56:22 [DEBUG   ] Finished updating board flags in 1.649 seconds
2019-01-17 18:56:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2019-01-17 18:56:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 18:57:05 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 18:57:13 [DEBUG   ] Got command RPT from MCS: ref #1199170
2019-01-17 18:57:13 [DEBUG   ] summary = ERROR
2019-01-17 18:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199170  13 58500 68233349 A  ERRORERROR'
2019-01-17 18:57:13 [DEBUG   ] Got command RPT from MCS: ref #1199171
2019-01-17 18:57:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199171  77 58500 68233553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:57:13 [DEBUG   ] Got command RPT from MCS: ref #1199172
2019-01-17 18:57:13 [DEBUG   ] summary = ERROR
2019-01-17 18:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199172  13 58500 68233757 A  ERRORERROR'
2019-01-17 18:57:13 [DEBUG   ] Got command RPT from MCS: ref #1199174
2019-01-17 18:57:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 18:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199174  77 58500 68233961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 18:57:14 [DEBUG   ] Got command RPT from MCS: ref #1199175
2019-01-17 18:57:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 18:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199175  12 58500 68234153 A  ERRORB•™š'
2019-01-17 18:57:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:57:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:57:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:57:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:57:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:57:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:57:22 [DEBUG   ] Finished updating board flags in 2.319 seconds
2019-01-17 18:57:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 18:57:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 18:58:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 18:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:58:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:58:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:58:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:58:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:58:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:58:22 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-01-17 18:58:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 18:58:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:59:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 18:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 18:59:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:59:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:59:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:59:22 [WARNING ] (13, 1, 'bot')
2019-01-17 18:59:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 18:59:22 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-17 18:59:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 18:59:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 19:00:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:00:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:00:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:00:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:00:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:00:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:00:22 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-17 19:00:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 19:00:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:01:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 19:01:05 [DEBUG   ] Got command RPT from MCS: ref #1199188
2019-01-17 19:01:05 [DEBUG   ] summary = ERROR
2019-01-17 19:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199188  13 58500 68465725 A  ERRORERROR'
2019-01-17 19:01:05 [DEBUG   ] Got command RPT from MCS: ref #1199189
2019-01-17 19:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199189  77 58500 68465726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:01:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:01:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:01:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:01:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:01:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:01:22 [DEBUG   ] Finished updating board flags in 1.972 seconds
2019-01-17 19:01:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 19:01:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 19:02:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 19:02:13 [DEBUG   ] Got command RPT from MCS: ref #1199205
2019-01-17 19:02:13 [DEBUG   ] summary = ERROR
2019-01-17 19:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199205  13 58500 68533441 A  ERRORERROR'
2019-01-17 19:02:13 [DEBUG   ] Got command RPT from MCS: ref #1199206
2019-01-17 19:02:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199206  77 58500 68533633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:02:13 [DEBUG   ] Got command RPT from MCS: ref #1199207
2019-01-17 19:02:13 [DEBUG   ] summary = ERROR
2019-01-17 19:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199207  13 58500 68533837 A  ERRORERROR'
2019-01-17 19:02:14 [DEBUG   ] Got command RPT from MCS: ref #1199208
2019-01-17 19:02:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199208  77 58500 68534041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:02:14 [DEBUG   ] Got command RPT from MCS: ref #1199209
2019-01-17 19:02:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199209  12 58500 68534233 A  ERRORB—™š'
2019-01-17 19:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:02:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:02:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:02:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:02:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:02:22 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-17 19:02:26 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2019-01-17 19:02:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 19:03:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 19:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:03:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:03:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:03:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:03:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:03:22 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-17 19:03:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 19:03:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 19:04:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 19:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:04:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:04:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:04:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:04:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:04:22 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-17 19:04:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:04:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 19:05:06 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2019-01-17 19:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:05:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:05:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:05:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:05:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:05:22 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-17 19:05:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 19:05:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 19:06:05 [DEBUG   ] Got command RPT from MCS: ref #1199214
2019-01-17 19:06:05 [DEBUG   ] summary = ERROR
2019-01-17 19:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199214  13 58500 68765733 A  ERRORERROR'
2019-01-17 19:06:05 [DEBUG   ] Got command RPT from MCS: ref #1199215
2019-01-17 19:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199215  77 58500 68765734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:06:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 19:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:06:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:06:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:06:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:06:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:06:22 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-17 19:06:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 19:06:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 19:07:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:07:13 [DEBUG   ] Got command RPT from MCS: ref #1199237
2019-01-17 19:07:13 [DEBUG   ] summary = ERROR
2019-01-17 19:07:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199237  13 58500 68833517 A  ERRORERROR'
2019-01-17 19:07:13 [DEBUG   ] Got command RPT from MCS: ref #1199238
2019-01-17 19:07:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:07:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199238  77 58500 68833721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:07:13 [DEBUG   ] Got command RPT from MCS: ref #1199239
2019-01-17 19:07:13 [DEBUG   ] summary = ERROR
2019-01-17 19:07:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199239  13 58500 68833913 A  ERRORERROR'
2019-01-17 19:07:14 [DEBUG   ] Got command RPT from MCS: ref #1199241
2019-01-17 19:07:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199241  77 58500 68834117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:07:14 [DEBUG   ] Got command RPT from MCS: ref #1199243
2019-01-17 19:07:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199243  12 58500 68834321 A  ERRORB–™š'
2019-01-17 19:07:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:07:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:07:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:07:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:07:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:07:22 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-17 19:07:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:07:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 19:08:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 19:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:08:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:08:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:08:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:08:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:08:22 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-17 19:08:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:08:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:09:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:09:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:09:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:09:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:09:22 [WARNING ] (13, 1, 'bot')
2019-01-17 19:09:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:09:22 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-01-17 19:09:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 19:09:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:10:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 19:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:10:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:10:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:10:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:10:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:10:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:10:23 [DEBUG   ] Finished updating board flags in 2.062 seconds
2019-01-17 19:10:27 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-17 19:10:48 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 19:11:05 [DEBUG   ] Got command RPT from MCS: ref #1199251
2019-01-17 19:11:05 [DEBUG   ] summary = ERROR
2019-01-17 19:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199251  13 58500 69065729 A  ERRORERROR'
2019-01-17 19:11:05 [DEBUG   ] Got command RPT from MCS: ref #1199252
2019-01-17 19:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199252  77 58500 69065730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:11:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 19:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:11:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:11:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:11:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:11:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:11:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:11:23 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-17 19:11:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 19:11:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 19:12:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:12:13 [DEBUG   ] Got command RPT from MCS: ref #1199268
2019-01-17 19:12:13 [DEBUG   ] summary = ERROR
2019-01-17 19:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199268  13 58500 69133597 A  ERRORERROR'
2019-01-17 19:12:13 [DEBUG   ] Got command RPT from MCS: ref #1199269
2019-01-17 19:12:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199269  77 58500 69133801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:12:13 [DEBUG   ] Got command RPT from MCS: ref #1199270
2019-01-17 19:12:13 [DEBUG   ] summary = ERROR
2019-01-17 19:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199270  13 58500 69133993 A  ERRORERROR'
2019-01-17 19:12:14 [DEBUG   ] Got command RPT from MCS: ref #1199271
2019-01-17 19:12:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:12:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199271  77 58500 69134197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:12:14 [DEBUG   ] Got command RPT from MCS: ref #1199272
2019-01-17 19:12:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:12:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199272  12 58500 69134401 A  ERRORB•™š'
2019-01-17 19:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:12:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 19:12:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:12:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:12:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:12:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:12:23 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-17 19:12:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:12:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:13:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:13:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:13:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:13:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:13:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:13:23 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-17 19:13:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:13:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:14:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 19:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:14:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:14:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:14:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:14:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:14:23 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-17 19:14:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 19:14:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:15:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:15:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:15:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:15:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:15:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:15:23 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-17 19:15:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:15:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 19:16:05 [DEBUG   ] Got command RPT from MCS: ref #1199281
2019-01-17 19:16:05 [DEBUG   ] summary = ERROR
2019-01-17 19:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199281  13 58500 69365729 A  ERRORERROR'
2019-01-17 19:16:05 [DEBUG   ] Got command RPT from MCS: ref #1199282
2019-01-17 19:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199282  77 58500 69365730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:16:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:16:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:16:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:16:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:16:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:16:23 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-17 19:16:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 19:16:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 19:17:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 19:17:13 [DEBUG   ] Got command RPT from MCS: ref #1199300
2019-01-17 19:17:13 [DEBUG   ] summary = ERROR
2019-01-17 19:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199300  13 58500 69433673 A  ERRORERROR'
2019-01-17 19:17:13 [DEBUG   ] Got command RPT from MCS: ref #1199301
2019-01-17 19:17:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199301  77 58500 69433877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:17:14 [DEBUG   ] Got command RPT from MCS: ref #1199302
2019-01-17 19:17:14 [DEBUG   ] summary = ERROR
2019-01-17 19:17:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199302  13 58500 69434081 A  ERRORERROR'
2019-01-17 19:17:14 [DEBUG   ] Got command RPT from MCS: ref #1199304
2019-01-17 19:17:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:17:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199304  77 58500 69434285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:17:14 [DEBUG   ] Got command RPT from MCS: ref #1199306
2019-01-17 19:17:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:17:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199306  12 58500 69434477 A  ERRORB•™š'
2019-01-17 19:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:17:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:17:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:17:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:17:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:17:23 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-17 19:17:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 19:17:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 19:18:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 19:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:18:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 19:18:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:18:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:18:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:18:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:18:23 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-17 19:18:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:18:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:19:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:19:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:19:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:19:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:19:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:19:23 [WARNING ] (13, 1, 'bot')
2019-01-17 19:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:19:23 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-17 19:19:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 19:19:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:20:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 19:20:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:20:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:20:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:20:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:20:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:20:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:20:24 [DEBUG   ] Finished updating board flags in 2.062 seconds
2019-01-17 19:20:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:20:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 19:21:05 [DEBUG   ] Got command RPT from MCS: ref #1199314
2019-01-17 19:21:05 [DEBUG   ] summary = ERROR
2019-01-17 19:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199314  13 58500 69665737 A  ERRORERROR'
2019-01-17 19:21:05 [DEBUG   ] Got command RPT from MCS: ref #1199315
2019-01-17 19:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199315  77 58500 69665738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:21:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:21:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:21:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:21:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:21:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:21:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:21:24 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-17 19:21:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:21:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:22:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 19:22:13 [DEBUG   ] Got command RPT from MCS: ref #1199335
2019-01-17 19:22:13 [DEBUG   ] summary = ERROR
2019-01-17 19:22:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199335  13 58500 69733757 A  ERRORERROR'
2019-01-17 19:22:13 [DEBUG   ] Got command RPT from MCS: ref #1199336
2019-01-17 19:22:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:22:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199336  77 58500 69733961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:22:14 [DEBUG   ] Got command RPT from MCS: ref #1199337
2019-01-17 19:22:14 [DEBUG   ] summary = ERROR
2019-01-17 19:22:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199337  13 58500 69734165 A  ERRORERROR'
2019-01-17 19:22:14 [DEBUG   ] Got command RPT from MCS: ref #1199338
2019-01-17 19:22:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:22:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199338  77 58500 69734357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:22:14 [DEBUG   ] Got command RPT from MCS: ref #1199339
2019-01-17 19:22:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:22:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199339  12 58500 69734561 A  ERRORB”™š'
2019-01-17 19:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:22:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:22:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:22:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:22:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:22:24 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-17 19:22:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 19:22:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 19:23:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 19:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:23:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:23:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:23:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:23:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:23:24 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-17 19:23:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 19:23:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 19:24:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 19:24:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 19:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:24:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:24:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:24:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:24:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:24:24 [DEBUG   ] Finished updating board flags in 1.886 seconds
2019-01-17 19:24:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 19:24:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:25:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:25:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:25:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:25:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:25:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:25:24 [DEBUG   ] Finished updating board flags in 1.704 seconds
2019-01-17 19:25:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:25:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 19:26:05 [DEBUG   ] Got command RPT from MCS: ref #1199344
2019-01-17 19:26:05 [DEBUG   ] summary = ERROR
2019-01-17 19:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199344  13 58500 69965733 A  ERRORERROR'
2019-01-17 19:26:05 [DEBUG   ] Got command RPT from MCS: ref #1199345
2019-01-17 19:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199345  77 58500 69965734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:26:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:26:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 19:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:26:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 19:26:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:26:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:26:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:26:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:26:24 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-17 19:26:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:26:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:27:10 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-17 19:27:13 [DEBUG   ] Got command RPT from MCS: ref #1199363
2019-01-17 19:27:13 [DEBUG   ] summary = ERROR
2019-01-17 19:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199363  13 58500 70033833 A  ERRORERROR'
2019-01-17 19:27:14 [DEBUG   ] Got command RPT from MCS: ref #1199364
2019-01-17 19:27:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:27:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199364  77 58500 70034037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:27:14 [DEBUG   ] Got command RPT from MCS: ref #1199365
2019-01-17 19:27:14 [DEBUG   ] summary = ERROR
2019-01-17 19:27:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199365  13 58500 70034241 A  ERRORERROR'
2019-01-17 19:27:14 [DEBUG   ] Got command RPT from MCS: ref #1199367
2019-01-17 19:27:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:27:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199367  77 58500 70034445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:27:14 [DEBUG   ] Got command RPT from MCS: ref #1199368
2019-01-17 19:27:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:27:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199368  12 58500 70034637 A  ERRORB–™š'
2019-01-17 19:27:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 19:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:27:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:27:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:27:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:27:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:27:24 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-17 19:27:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:27:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:28:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:28:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:28:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:28:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:28:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:28:24 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-17 19:28:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 19:28:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 19:29:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 19:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:29:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 19:29:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:29:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:29:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:29:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:29:24 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-17 19:29:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 19:29:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 19:30:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 19:30:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:30:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:30:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:30:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:30:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:30:24 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-17 19:30:31 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-17 19:30:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:31:05 [DEBUG   ] Got command RPT from MCS: ref #1199381
2019-01-17 19:31:05 [DEBUG   ] summary = ERROR
2019-01-17 19:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199381  13 58500 70265737 A  ERRORERROR'
2019-01-17 19:31:05 [DEBUG   ] Got command RPT from MCS: ref #1199382
2019-01-17 19:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199382  77 58500 70265738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:31:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:31:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:31:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:31:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:31:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:31:24 [WARNING ] (13, 1, 'bot')
2019-01-17 19:31:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:31:24 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-17 19:31:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:31:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 19:32:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:32:13 [DEBUG   ] Got command RPT from MCS: ref #1199398
2019-01-17 19:32:13 [DEBUG   ] summary = ERROR
2019-01-17 19:32:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199398  13 58500 70333921 A  ERRORERROR'
2019-01-17 19:32:14 [DEBUG   ] Got command RPT from MCS: ref #1199399
2019-01-17 19:32:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:32:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199399  77 58500 70334113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:32:14 [DEBUG   ] Got command RPT from MCS: ref #1199400
2019-01-17 19:32:14 [DEBUG   ] summary = ERROR
2019-01-17 19:32:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199400  13 58500 70334317 A  ERRORERROR'
2019-01-17 19:32:14 [DEBUG   ] Got command RPT from MCS: ref #1199401
2019-01-17 19:32:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:32:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199401  77 58500 70334521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:32:14 [DEBUG   ] Got command RPT from MCS: ref #1199402
2019-01-17 19:32:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:32:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199402  12 58500 70334725 A  ERRORB˜™š'
2019-01-17 19:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:32:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:32:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:32:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:32:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:32:25 [DEBUG   ] Finished updating board flags in 2.203 seconds
2019-01-17 19:32:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:32:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:33:12 [DEBUG   ] Finished updating ant stats in 1.798 seconds
2019-01-17 19:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:33:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:33:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:33:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:33:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:33:25 [DEBUG   ] Finished updating board flags in 2.190 seconds
2019-01-17 19:33:31 [DEBUG   ] Finished updating ant stats in 0.566 seconds
2019-01-17 19:33:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-17 19:34:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 19:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:34:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:34:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:34:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:34:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:34:25 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-17 19:34:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 19:34:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 19:35:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 19:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:35:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:35:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:35:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:35:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:35:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:35:25 [DEBUG   ] Finished updating board flags in 2.049 seconds
2019-01-17 19:35:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 19:35:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:36:05 [DEBUG   ] Got command RPT from MCS: ref #1199407
2019-01-17 19:36:05 [DEBUG   ] summary = ERROR
2019-01-17 19:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199407  13 58500 70565733 A  ERRORERROR'
2019-01-17 19:36:05 [DEBUG   ] Got command RPT from MCS: ref #1199408
2019-01-17 19:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199408  77 58500 70565734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:36:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:36:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 19:36:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:36:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:36:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:36:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:36:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:36:25 [DEBUG   ] Finished updating board flags in 1.948 seconds
2019-01-17 19:36:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:36:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:37:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:37:13 [DEBUG   ] Got command RPT from MCS: ref #1199430
2019-01-17 19:37:13 [DEBUG   ] summary = ERROR
2019-01-17 19:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199430  13 58500 70633993 A  ERRORERROR'
2019-01-17 19:37:14 [DEBUG   ] Got command RPT from MCS: ref #1199431
2019-01-17 19:37:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199431  77 58500 70634197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:37:14 [DEBUG   ] Got command RPT from MCS: ref #1199432
2019-01-17 19:37:14 [DEBUG   ] summary = ERROR
2019-01-17 19:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199432  13 58500 70634401 A  ERRORERROR'
2019-01-17 19:37:14 [DEBUG   ] Got command RPT from MCS: ref #1199434
2019-01-17 19:37:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199434  77 58500 70634605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:37:14 [DEBUG   ] Got command RPT from MCS: ref #1199436
2019-01-17 19:37:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199436  12 58500 70634797 A  ERRORB—™š'
2019-01-17 19:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:37:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:37:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:37:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:37:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:37:25 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-17 19:37:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:37:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:38:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:38:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:38:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:38:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:38:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:38:25 [DEBUG   ] Finished updating board flags in 1.852 seconds
2019-01-17 19:38:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:38:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:39:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:39:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:39:25 [DEBUG   ] Finished updating board flags in 1.735 seconds
2019-01-17 19:39:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 19:39:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:40:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:40:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:40:25 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-17 19:40:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:40:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 19:41:05 [DEBUG   ] Got command RPT from MCS: ref #1199444
2019-01-17 19:41:05 [DEBUG   ] summary = ERROR
2019-01-17 19:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199444  13 58500 70865741 A  ERRORERROR'
2019-01-17 19:41:05 [DEBUG   ] Got command RPT from MCS: ref #1199445
2019-01-17 19:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199445  77 58500 70865742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:41:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:41:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 19:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:41:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:41:25 [DEBUG   ] Finished updating board flags in 1.575 seconds
2019-01-17 19:41:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 19:41:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 19:42:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 19:42:14 [DEBUG   ] Got command RPT from MCS: ref #1199461
2019-01-17 19:42:14 [DEBUG   ] summary = ERROR
2019-01-17 19:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199461  13 58500 70934085 A  ERRORERROR'
2019-01-17 19:42:14 [DEBUG   ] Got command RPT from MCS: ref #1199462
2019-01-17 19:42:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199462  77 58500 70934277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:42:14 [DEBUG   ] Got command RPT from MCS: ref #1199463
2019-01-17 19:42:14 [DEBUG   ] summary = ERROR
2019-01-17 19:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199463  13 58500 70934481 A  ERRORERROR'
2019-01-17 19:42:14 [DEBUG   ] Got command RPT from MCS: ref #1199464
2019-01-17 19:42:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199464  77 58500 70934685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:42:14 [DEBUG   ] Got command RPT from MCS: ref #1199465
2019-01-17 19:42:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199465  12 58500 70934877 A  ERRORB–™š'
2019-01-17 19:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:42:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:42:25 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-17 19:42:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 19:42:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 19:43:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 19:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:43:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:43:25 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-17 19:43:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:43:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:44:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:44:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:44:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:44:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:44:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:44:25 [WARNING ] (13, 1, 'bot')
2019-01-17 19:44:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:44:25 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-17 19:44:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:44:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:45:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:45:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:45:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:45:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:45:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:45:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:45:26 [DEBUG   ] Finished updating board flags in 2.068 seconds
2019-01-17 19:45:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:45:53 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-17 19:46:05 [DEBUG   ] Got command RPT from MCS: ref #1199474
2019-01-17 19:46:05 [DEBUG   ] summary = ERROR
2019-01-17 19:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199474  13 58500 71165733 A  ERRORERROR'
2019-01-17 19:46:05 [DEBUG   ] Got command RPT from MCS: ref #1199475
2019-01-17 19:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199475  77 58500 71165734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:46:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 19:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:46:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:46:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:46:26 [DEBUG   ] Finished updating board flags in 1.958 seconds
2019-01-17 19:46:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 19:46:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:47:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 19:47:14 [DEBUG   ] Got command RPT from MCS: ref #1199493
2019-01-17 19:47:14 [DEBUG   ] summary = ERROR
2019-01-17 19:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199493  13 58500 71234165 A  ERRORERROR'
2019-01-17 19:47:14 [DEBUG   ] Got command RPT from MCS: ref #1199494
2019-01-17 19:47:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199494  77 58500 71234357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:47:14 [DEBUG   ] Got command RPT from MCS: ref #1199495
2019-01-17 19:47:14 [DEBUG   ] summary = ERROR
2019-01-17 19:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199495  13 58500 71234561 A  ERRORERROR'
2019-01-17 19:47:14 [DEBUG   ] Got command RPT from MCS: ref #1199497
2019-01-17 19:47:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199497  77 58500 71234765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:47:14 [DEBUG   ] Got command RPT from MCS: ref #1199498
2019-01-17 19:47:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199498  12 58500 71234969 A  ERRORB•™š'
2019-01-17 19:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:47:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:47:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:47:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:47:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:47:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:47:26 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-17 19:47:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:47:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:48:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:48:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 19:48:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:48:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:48:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:48:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:48:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:48:26 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-01-17 19:48:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 19:48:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 19:49:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 19:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:49:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 19:49:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:49:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:49:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:49:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:49:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:49:26 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-17 19:49:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 19:49:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:50:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:50:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:50:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:50:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:50:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:50:26 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-17 19:50:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 19:50:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 19:51:05 [DEBUG   ] Got command RPT from MCS: ref #1199507
2019-01-17 19:51:05 [DEBUG   ] summary = ERROR
2019-01-17 19:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199507  13 58500 71465745 A  ERRORERROR'
2019-01-17 19:51:05 [DEBUG   ] Got command RPT from MCS: ref #1199508
2019-01-17 19:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199508  77 58500 71465746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:51:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 19:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:51:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:51:26 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-01-17 19:51:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 19:51:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:52:14 [DEBUG   ] Got command RPT from MCS: ref #1199528
2019-01-17 19:52:14 [DEBUG   ] summary = ERROR
2019-01-17 19:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199528  13 58500 71534245 A  ERRORERROR'
2019-01-17 19:52:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:52:14 [DEBUG   ] Got command RPT from MCS: ref #1199529
2019-01-17 19:52:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199529  77 58500 71534449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:52:14 [DEBUG   ] Got command RPT from MCS: ref #1199530
2019-01-17 19:52:14 [DEBUG   ] summary = ERROR
2019-01-17 19:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199530  13 58500 71534641 A  ERRORERROR'
2019-01-17 19:52:14 [DEBUG   ] Got command RPT from MCS: ref #1199531
2019-01-17 19:52:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199531  77 58500 71534845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:52:15 [DEBUG   ] Got command RPT from MCS: ref #1199532
2019-01-17 19:52:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:52:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199532  12 58500 71535049 A  ERRORB•™š'
2019-01-17 19:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:52:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:52:26 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-17 19:52:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 19:52:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 19:53:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:53:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:53:26 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-17 19:53:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 19:53:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 19:54:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 19:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:54:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:54:26 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-17 19:54:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 19:54:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 19:55:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 19:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:55:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:55:26 [DEBUG   ] Finished updating board flags in 1.512 seconds
2019-01-17 19:55:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 19:55:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:56:05 [DEBUG   ] Got command RPT from MCS: ref #1199537
2019-01-17 19:56:05 [DEBUG   ] summary = ERROR
2019-01-17 19:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199537  13 58500 71765745 A  ERRORERROR'
2019-01-17 19:56:05 [DEBUG   ] Got command RPT from MCS: ref #1199538
2019-01-17 19:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199538  77 58500 71765746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:56:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 19:56:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:56:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 19:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:56:26 [WARNING ] (13, 1, 'bot')
2019-01-17 19:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:56:26 [DEBUG   ] Finished updating board flags in 1.509 seconds
2019-01-17 19:56:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 19:56:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 19:57:14 [DEBUG   ] Got command RPT from MCS: ref #1199556
2019-01-17 19:57:14 [DEBUG   ] summary = ERROR
2019-01-17 19:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199556  13 58500 71834325 A  ERRORERROR'
2019-01-17 19:57:14 [DEBUG   ] Got command RPT from MCS: ref #1199557
2019-01-17 19:57:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199557  77 58500 71834521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:57:14 [DEBUG   ] Got command RPT from MCS: ref #1199558
2019-01-17 19:57:14 [DEBUG   ] summary = ERROR
2019-01-17 19:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199558  13 58500 71834725 A  ERRORERROR'
2019-01-17 19:57:14 [DEBUG   ] Got command RPT from MCS: ref #1199560
2019-01-17 19:57:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 19:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199560  77 58500 71834929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 19:57:15 [DEBUG   ] Got command RPT from MCS: ref #1199561
2019-01-17 19:57:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 19:57:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199561  12 58500 71835133 A  ERRORB•™š'
2019-01-17 19:57:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:57:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:57:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:57:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:57:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:57:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:57:27 [DEBUG   ] Finished updating board flags in 2.273 seconds
2019-01-17 19:57:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 19:57:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 19:58:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 19:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:58:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:58:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:58:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:58:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:58:27 [DEBUG   ] Finished updating board flags in 2.091 seconds
2019-01-17 19:58:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:58:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 19:59:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 19:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 19:59:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:59:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:59:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:59:27 [WARNING ] (13, 1, 'bot')
2019-01-17 19:59:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 19:59:27 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-17 19:59:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 19:59:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 20:00:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 20:00:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:00:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:00:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:00:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:00:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:00:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:00:27 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-17 20:00:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 20:00:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:01:05 [DEBUG   ] Got command RPT from MCS: ref #1199574
2019-01-17 20:01:05 [DEBUG   ] summary = ERROR
2019-01-17 20:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199574  13 58500 72065741 A  ERRORERROR'
2019-01-17 20:01:05 [DEBUG   ] Got command RPT from MCS: ref #1199575
2019-01-17 20:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199575  77 58500 72065742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:01:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 20:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:01:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:01:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:01:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:01:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:01:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:01:27 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-17 20:01:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:01:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:02:14 [DEBUG   ] Got command RPT from MCS: ref #1199591
2019-01-17 20:02:14 [DEBUG   ] summary = ERROR
2019-01-17 20:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199591  13 58500 72134409 A  ERRORERROR'
2019-01-17 20:02:14 [DEBUG   ] Got command RPT from MCS: ref #1199592
2019-01-17 20:02:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199592  77 58500 72134613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:02:14 [DEBUG   ] Got command RPT from MCS: ref #1199593
2019-01-17 20:02:14 [DEBUG   ] summary = ERROR
2019-01-17 20:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199593  13 58500 72134805 A  ERRORERROR'
2019-01-17 20:02:15 [DEBUG   ] Got command RPT from MCS: ref #1199594
2019-01-17 20:02:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199594  77 58500 72135009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:02:15 [DEBUG   ] Got command RPT from MCS: ref #1199595
2019-01-17 20:02:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199595  12 58500 72135213 A  ERRORB”™š'
2019-01-17 20:02:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:02:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:02:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:02:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:02:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:02:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:02:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:02:27 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-17 20:02:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:02:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 20:03:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 20:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:03:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:03:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:03:27 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-17 20:03:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:03:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 20:04:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 20:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:04:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:04:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:04:27 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-01-17 20:04:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 20:04:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:05:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:05:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:05:27 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-01-17 20:05:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:05:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 20:06:05 [DEBUG   ] Got command RPT from MCS: ref #1199600
2019-01-17 20:06:05 [DEBUG   ] summary = ERROR
2019-01-17 20:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199600  13 58500 72365741 A  ERRORERROR'
2019-01-17 20:06:05 [DEBUG   ] Got command RPT from MCS: ref #1199601
2019-01-17 20:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199601  77 58500 72365742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:06:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:06:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:06:27 [DEBUG   ] Finished updating board flags in 1.569 seconds
2019-01-17 20:06:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:06:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:07:14 [DEBUG   ] Got command RPT from MCS: ref #1199623
2019-01-17 20:07:14 [DEBUG   ] summary = ERROR
2019-01-17 20:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199623  13 58500 72434481 A  ERRORERROR'
2019-01-17 20:07:14 [DEBUG   ] Got command RPT from MCS: ref #1199624
2019-01-17 20:07:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199624  77 58500 72434685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:07:14 [DEBUG   ] Got command RPT from MCS: ref #1199625
2019-01-17 20:07:14 [DEBUG   ] summary = ERROR
2019-01-17 20:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199625  13 58500 72434889 A  ERRORERROR'
2019-01-17 20:07:15 [DEBUG   ] Got command RPT from MCS: ref #1199627
2019-01-17 20:07:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199627  77 58500 72435093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:07:15 [DEBUG   ] Got command RPT from MCS: ref #1199628
2019-01-17 20:07:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199628  12 58500 72435285 A  ERRORB”™š'
2019-01-17 20:07:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 20:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:07:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 20:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:07:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:07:27 [DEBUG   ] Finished updating board flags in 1.547 seconds
2019-01-17 20:07:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 20:07:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 20:08:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 20:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:08:27 [WARNING ] (13, 1, 'bot')
2019-01-17 20:08:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:08:27 [DEBUG   ] Finished updating board flags in 1.553 seconds
2019-01-17 20:08:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 20:08:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 20:09:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 20:09:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 20:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:09:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:09:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:09:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:09:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:09:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:09:28 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-17 20:09:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 20:09:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 20:10:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:10:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:10:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 20:10:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:10:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:10:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:10:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:10:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:10:28 [DEBUG   ] Finished updating board flags in 2.214 seconds
2019-01-17 20:10:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:10:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 20:11:05 [DEBUG   ] Got command RPT from MCS: ref #1199637
2019-01-17 20:11:05 [DEBUG   ] summary = ERROR
2019-01-17 20:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199637  13 58500 72665745 A  ERRORERROR'
2019-01-17 20:11:05 [DEBUG   ] Got command RPT from MCS: ref #1199638
2019-01-17 20:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199638  77 58500 72665746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:11:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:11:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:11:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:11:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:11:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:11:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:11:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:11:28 [DEBUG   ] Finished updating board flags in 2.092 seconds
2019-01-17 20:11:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:11:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:12:14 [DEBUG   ] Got command RPT from MCS: ref #1199654
2019-01-17 20:12:14 [DEBUG   ] summary = ERROR
2019-01-17 20:12:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199654  13 58500 72734569 A  ERRORERROR'
2019-01-17 20:12:14 [DEBUG   ] Got command RPT from MCS: ref #1199655
2019-01-17 20:12:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:12:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199655  77 58500 72734761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:12:14 [DEBUG   ] Got command RPT from MCS: ref #1199656
2019-01-17 20:12:14 [DEBUG   ] summary = ERROR
2019-01-17 20:12:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199656  13 58500 72734965 A  ERRORERROR'
2019-01-17 20:12:15 [DEBUG   ] Got command RPT from MCS: ref #1199657
2019-01-17 20:12:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199657  77 58500 72735169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:12:15 [DEBUG   ] Got command RPT from MCS: ref #1199658
2019-01-17 20:12:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199658  12 58500 72735373 A  ERRORB—™š'
2019-01-17 20:12:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 20:12:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 20:12:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:12:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:12:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:12:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:12:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:12:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:12:28 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-17 20:12:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:12:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:13:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:13:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:13:28 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 20:13:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:13:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:13:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:13:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:13:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:13:28 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-17 20:13:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 20:13:58 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 20:14:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 20:14:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:14:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 20:14:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:14:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:14:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:14:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:14:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:14:28 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-17 20:14:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 20:14:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:15:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 20:15:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 20:15:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:15:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:15:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:15:28 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-17 20:15:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:15:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 20:16:05 [DEBUG   ] Got command RPT from MCS: ref #1199667
2019-01-17 20:16:05 [DEBUG   ] summary = ERROR
2019-01-17 20:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199667  13 58500 72965745 A  ERRORERROR'
2019-01-17 20:16:05 [DEBUG   ] Got command RPT from MCS: ref #1199668
2019-01-17 20:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199668  77 58500 72965746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:16:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 20:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:16:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:16:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:16:28 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-17 20:16:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:16:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 20:17:14 [DEBUG   ] Got command RPT from MCS: ref #1199686
2019-01-17 20:17:14 [DEBUG   ] summary = ERROR
2019-01-17 20:17:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199686  13 58500 73034645 A  ERRORERROR'
2019-01-17 20:17:14 [DEBUG   ] Got command RPT from MCS: ref #1199687
2019-01-17 20:17:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:17:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199687  77 58500 73034849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:17:15 [DEBUG   ] Got command RPT from MCS: ref #1199688
2019-01-17 20:17:15 [DEBUG   ] summary = ERROR
2019-01-17 20:17:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199688  13 58500 73035053 A  ERRORERROR'
2019-01-17 20:17:15 [DEBUG   ] Got command RPT from MCS: ref #1199690
2019-01-17 20:17:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:17:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199690  77 58500 73035245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:17:15 [DEBUG   ] Got command RPT from MCS: ref #1199691
2019-01-17 20:17:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:17:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199691  12 58500 73035449 A  ERRORB˜™š'
2019-01-17 20:17:19 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 20:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:17:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:17:28 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-17 20:17:39 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-17 20:17:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 20:18:19 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-17 20:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:18:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:18:28 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-01-17 20:18:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:18:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:19:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 20:19:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 20:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:19:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:19:28 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-17 20:19:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:19:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:20:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 20:20:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:20:28 [WARNING ] (13, 1, 'bot')
2019-01-17 20:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:20:28 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-17 20:20:40 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 20:21:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 20:21:05 [DEBUG   ] Got command RPT from MCS: ref #1199700
2019-01-17 20:21:05 [DEBUG   ] summary = ERROR
2019-01-17 20:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199700  13 58500 73265745 A  ERRORERROR'
2019-01-17 20:21:05 [DEBUG   ] Got command RPT from MCS: ref #1199701
2019-01-17 20:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199701  77 58500 73265746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:21:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 20:21:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:21:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:21:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:21:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:21:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:21:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:21:29 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-01-17 20:21:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 20:22:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 20:22:14 [DEBUG   ] Got command RPT from MCS: ref #1199721
2019-01-17 20:22:14 [DEBUG   ] summary = ERROR
2019-01-17 20:22:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199721  13 58500 73334733 A  ERRORERROR'
2019-01-17 20:22:14 [DEBUG   ] Got command RPT from MCS: ref #1199722
2019-01-17 20:22:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:22:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199722  77 58500 73334925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:22:15 [DEBUG   ] Got command RPT from MCS: ref #1199723
2019-01-17 20:22:15 [DEBUG   ] summary = ERROR
2019-01-17 20:22:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199723  13 58500 73335129 A  ERRORERROR'
2019-01-17 20:22:15 [DEBUG   ] Got command RPT from MCS: ref #1199724
2019-01-17 20:22:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:22:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199724  77 58500 73335333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:22:15 [DEBUG   ] Got command RPT from MCS: ref #1199725
2019-01-17 20:22:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:22:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199725  12 58500 73335537 A  ERRORB—™š'
2019-01-17 20:22:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 20:22:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:22:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 20:22:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:22:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:22:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:22:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:22:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:22:29 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-17 20:22:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:23:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 20:23:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 20:23:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:23:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 20:23:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:23:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:23:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:23:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:23:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:23:29 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-17 20:23:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:24:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 20:24:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 20:24:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:24:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:24:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:24:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:24:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:24:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:24:29 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-17 20:24:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 20:25:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-17 20:25:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 20:25:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:25:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:25:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:25:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:25:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:25:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:25:29 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-17 20:25:41 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 20:26:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-17 20:26:05 [DEBUG   ] Got command RPT from MCS: ref #1199730
2019-01-17 20:26:05 [DEBUG   ] summary = ERROR
2019-01-17 20:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199730  13 58500 73565749 A  ERRORERROR'
2019-01-17 20:26:05 [DEBUG   ] Got command RPT from MCS: ref #1199731
2019-01-17 20:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199731  77 58500 73565750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:26:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 20:26:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:26:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:26:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:26:29 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-17 20:26:41 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-17 20:27:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 20:27:14 [DEBUG   ] Got command RPT from MCS: ref #1199749
2019-01-17 20:27:14 [DEBUG   ] summary = ERROR
2019-01-17 20:27:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199749  13 58500 73634809 A  ERRORERROR'
2019-01-17 20:27:15 [DEBUG   ] Got command RPT from MCS: ref #1199750
2019-01-17 20:27:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199750  77 58500 73635013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:27:15 [DEBUG   ] Got command RPT from MCS: ref #1199751
2019-01-17 20:27:15 [DEBUG   ] summary = ERROR
2019-01-17 20:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199751  13 58500 73635217 A  ERRORERROR'
2019-01-17 20:27:15 [DEBUG   ] Got command RPT from MCS: ref #1199753
2019-01-17 20:27:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199753  77 58500 73635409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:27:15 [DEBUG   ] Got command RPT from MCS: ref #1199755
2019-01-17 20:27:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199755  12 58500 73635613 A  ERRORB–™š'
2019-01-17 20:27:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:27:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:27:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:27:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:27:29 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-17 20:27:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:28:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:28:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 20:28:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:28:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:28:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:28:29 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-17 20:28:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:29:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 20:29:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 20:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:29:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:29:29 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-17 20:29:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:30:01 [DEBUG   ] Finished updating ant stats in 0.610 seconds
2019-01-17 20:30:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-17 20:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:30:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:30:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:30:29 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-17 20:30:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 20:31:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 20:31:05 [DEBUG   ] Got command RPT from MCS: ref #1199767
2019-01-17 20:31:05 [DEBUG   ] summary = ERROR
2019-01-17 20:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199767  13 58500 73865745 A  ERRORERROR'
2019-01-17 20:31:05 [DEBUG   ] Got command RPT from MCS: ref #1199768
2019-01-17 20:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199768  77 58500 73865746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:31:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 20:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:31:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 20:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:31:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:31:29 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-17 20:31:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 20:32:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:32:14 [DEBUG   ] Got command RPT from MCS: ref #1199784
2019-01-17 20:32:14 [DEBUG   ] summary = ERROR
2019-01-17 20:32:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199784  13 58500 73934897 A  ERRORERROR'
2019-01-17 20:32:15 [DEBUG   ] Got command RPT from MCS: ref #1199785
2019-01-17 20:32:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199785  77 58500 73935089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:32:15 [DEBUG   ] Got command RPT from MCS: ref #1199786
2019-01-17 20:32:15 [DEBUG   ] summary = ERROR
2019-01-17 20:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199786  13 58500 73935293 A  ERRORERROR'
2019-01-17 20:32:15 [DEBUG   ] Got command RPT from MCS: ref #1199787
2019-01-17 20:32:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199787  77 58500 73935497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:32:15 [DEBUG   ] Got command RPT from MCS: ref #1199788
2019-01-17 20:32:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199788  12 58500 73935689 A  ERRORB–™š'
2019-01-17 20:32:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:32:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:32:29 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-17 20:32:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 20:33:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 20:33:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 20:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:33:29 [WARNING ] (13, 1, 'bot')
2019-01-17 20:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:33:29 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-01-17 20:33:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:34:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 20:34:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-17 20:34:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:34:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:34:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:34:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:34:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:34:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:34:30 [DEBUG   ] Finished updating board flags in 2.080 seconds
2019-01-17 20:34:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:35:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 20:35:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:35:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:35:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:35:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:35:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:35:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:35:30 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-17 20:35:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 20:36:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 20:36:05 [DEBUG   ] Got command RPT from MCS: ref #1199793
2019-01-17 20:36:05 [DEBUG   ] summary = ERROR
2019-01-17 20:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199793  13 58500 74165745 A  ERRORERROR'
2019-01-17 20:36:05 [DEBUG   ] Got command RPT from MCS: ref #1199794
2019-01-17 20:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199794  77 58500 74165746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:36:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 20:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:36:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:36:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:36:30 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-17 20:36:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 20:37:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 20:37:14 [DEBUG   ] Got command RPT from MCS: ref #1199816
2019-01-17 20:37:14 [DEBUG   ] summary = ERROR
2019-01-17 20:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199816  13 58500 74234977 A  ERRORERROR'
2019-01-17 20:37:15 [DEBUG   ] Got command RPT from MCS: ref #1199817
2019-01-17 20:37:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:37:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199817  77 58500 74235181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:37:15 [DEBUG   ] Got command RPT from MCS: ref #1199818
2019-01-17 20:37:15 [DEBUG   ] summary = ERROR
2019-01-17 20:37:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199818  13 58500 74235373 A  ERRORERROR'
2019-01-17 20:37:15 [DEBUG   ] Got command RPT from MCS: ref #1199820
2019-01-17 20:37:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:37:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199820  77 58500 74235577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:37:15 [DEBUG   ] Got command RPT from MCS: ref #1199821
2019-01-17 20:37:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:37:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199821  12 58500 74235781 A  ERRORB•™š'
2019-01-17 20:37:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 20:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:37:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:37:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:37:30 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-01-17 20:37:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 20:38:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:38:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 20:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:38:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:38:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:38:30 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-17 20:38:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:39:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 20:39:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:39:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:39:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:39:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:39:30 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-17 20:39:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:40:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 20:40:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 20:40:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:40:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:40:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:40:30 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-17 20:40:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:41:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:41:05 [DEBUG   ] Got command RPT from MCS: ref #1199830
2019-01-17 20:41:05 [DEBUG   ] summary = ERROR
2019-01-17 20:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199830  13 58500 74465753 A  ERRORERROR'
2019-01-17 20:41:05 [DEBUG   ] Got command RPT from MCS: ref #1199831
2019-01-17 20:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199831  77 58500 74465754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:41:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:41:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:41:30 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-17 20:41:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 20:42:04 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 20:42:15 [DEBUG   ] Got command RPT from MCS: ref #1199847
2019-01-17 20:42:15 [DEBUG   ] summary = ERROR
2019-01-17 20:42:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199847  13 58500 74535057 A  ERRORERROR'
2019-01-17 20:42:15 [DEBUG   ] Got command RPT from MCS: ref #1199848
2019-01-17 20:42:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:42:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199848  77 58500 74535261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:42:15 [DEBUG   ] Got command RPT from MCS: ref #1199849
2019-01-17 20:42:15 [DEBUG   ] summary = ERROR
2019-01-17 20:42:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199849  13 58500 74535453 A  ERRORERROR'
2019-01-17 20:42:15 [DEBUG   ] Got command RPT from MCS: ref #1199850
2019-01-17 20:42:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:42:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199850  77 58500 74535657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:42:15 [DEBUG   ] Got command RPT from MCS: ref #1199851
2019-01-17 20:42:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:42:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199851  12 58500 74535861 A  ERRORB•™š'
2019-01-17 20:42:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 20:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:42:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:42:30 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-17 20:42:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 20:43:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:43:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:43:30 [WARNING ] (13, 1, 'bot')
2019-01-17 20:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:43:30 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-17 20:43:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 20:44:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 20:44:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:44:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:44:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:44:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:44:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:44:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:44:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:44:31 [DEBUG   ] Finished updating board flags in 2.029 seconds
2019-01-17 20:44:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:45:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:45:24 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-17 20:45:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:45:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:45:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:45:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:45:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:45:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:45:31 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-17 20:45:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 20:46:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 20:46:05 [DEBUG   ] Got command RPT from MCS: ref #1199860
2019-01-17 20:46:05 [DEBUG   ] summary = ERROR
2019-01-17 20:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199860  13 58500 74765753 A  ERRORERROR'
2019-01-17 20:46:05 [DEBUG   ] Got command RPT from MCS: ref #1199861
2019-01-17 20:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199861  77 58500 74765754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:46:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 20:46:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:46:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:46:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:46:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:46:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:46:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:46:31 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-01-17 20:46:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 20:47:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 20:47:15 [DEBUG   ] Got command RPT from MCS: ref #1199879
2019-01-17 20:47:15 [DEBUG   ] summary = ERROR
2019-01-17 20:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199879  13 58500 74835133 A  ERRORERROR'
2019-01-17 20:47:15 [DEBUG   ] Got command RPT from MCS: ref #1199880
2019-01-17 20:47:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199880  77 58500 74835337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:47:15 [DEBUG   ] Got command RPT from MCS: ref #1199881
2019-01-17 20:47:15 [DEBUG   ] summary = ERROR
2019-01-17 20:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199881  13 58500 74835541 A  ERRORERROR'
2019-01-17 20:47:15 [DEBUG   ] Got command RPT from MCS: ref #1199883
2019-01-17 20:47:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199883  77 58500 74835733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:47:15 [DEBUG   ] Got command RPT from MCS: ref #1199885
2019-01-17 20:47:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:47:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199885  12 58500 74835937 A  ERRORB•™š'
2019-01-17 20:47:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 20:47:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:47:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:47:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:47:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:47:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:47:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:47:31 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-17 20:47:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 20:48:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:48:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:48:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:48:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:48:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:48:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:48:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:48:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:48:31 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-17 20:48:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 20:49:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 20:49:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 20:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:49:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:49:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:49:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:49:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:49:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:49:31 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-17 20:49:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 20:50:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 20:50:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 20:50:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:50:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:50:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:50:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:50:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:50:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:50:31 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-17 20:50:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 20:51:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:51:05 [DEBUG   ] Got command RPT from MCS: ref #1199893
2019-01-17 20:51:05 [DEBUG   ] summary = ERROR
2019-01-17 20:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199893  13 58500 75065753 A  ERRORERROR'
2019-01-17 20:51:05 [DEBUG   ] Got command RPT from MCS: ref #1199894
2019-01-17 20:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199894  77 58500 75065754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:51:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 20:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:51:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:51:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:51:31 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-17 20:51:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 20:52:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 20:52:15 [DEBUG   ] Got command RPT from MCS: ref #1199914
2019-01-17 20:52:15 [DEBUG   ] summary = ERROR
2019-01-17 20:52:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199914  13 58500 75135217 A  ERRORERROR'
2019-01-17 20:52:15 [DEBUG   ] Got command RPT from MCS: ref #1199915
2019-01-17 20:52:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:52:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199915  77 58500 75135421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:52:15 [DEBUG   ] Got command RPT from MCS: ref #1199916
2019-01-17 20:52:15 [DEBUG   ] summary = ERROR
2019-01-17 20:52:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199916  13 58500 75135613 A  ERRORERROR'
2019-01-17 20:52:15 [DEBUG   ] Got command RPT from MCS: ref #1199917
2019-01-17 20:52:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:52:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199917  77 58500 75135817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:52:16 [DEBUG   ] Got command RPT from MCS: ref #1199918
2019-01-17 20:52:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:52:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199918  12 58500 75136021 A  ERRORB•™š'
2019-01-17 20:52:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 20:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:52:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:52:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:52:31 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-17 20:52:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 20:53:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:53:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 20:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:53:31 [WARNING ] (13, 1, 'bot')
2019-01-17 20:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:53:31 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-17 20:53:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 20:54:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 20:54:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 20:54:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:54:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:54:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:54:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:54:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:54:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:54:32 [DEBUG   ] Finished updating board flags in 2.160 seconds
2019-01-17 20:54:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 20:55:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 20:55:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 20:55:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:55:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:55:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:55:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:55:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:55:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:55:32 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-17 20:55:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 20:56:05 [DEBUG   ] Got command RPT from MCS: ref #1199923
2019-01-17 20:56:05 [DEBUG   ] summary = ERROR
2019-01-17 20:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199923  13 58500 75365750 A  ERRORERROR'
2019-01-17 20:56:05 [DEBUG   ] Got command RPT from MCS: ref #1199924
2019-01-17 20:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199924  77 58500 75365750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:56:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 20:56:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-17 20:56:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:56:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:56:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:56:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:56:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:56:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:56:32 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-17 20:56:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 20:57:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 20:57:15 [DEBUG   ] Got command RPT from MCS: ref #1199942
2019-01-17 20:57:15 [DEBUG   ] summary = ERROR
2019-01-17 20:57:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199942  13 58500 75435301 A  ERRORERROR'
2019-01-17 20:57:15 [DEBUG   ] Got command RPT from MCS: ref #1199943
2019-01-17 20:57:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:57:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199943  77 58500 75435493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:57:15 [DEBUG   ] Got command RPT from MCS: ref #1199944
2019-01-17 20:57:15 [DEBUG   ] summary = ERROR
2019-01-17 20:57:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199944  13 58500 75435697 A  ERRORERROR'
2019-01-17 20:57:15 [DEBUG   ] Got command RPT from MCS: ref #1199946
2019-01-17 20:57:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 20:57:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199946  77 58500 75435901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 20:57:16 [DEBUG   ] Got command RPT from MCS: ref #1199947
2019-01-17 20:57:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 20:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199947  12 58500 75436105 A  ERRORB”™š'
2019-01-17 20:57:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 20:57:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:57:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:57:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:57:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:57:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:57:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:57:32 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-17 20:57:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 20:58:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 20:58:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 20:58:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:58:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:58:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:58:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:58:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:58:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:58:32 [DEBUG   ] Finished updating board flags in 1.858 seconds
2019-01-17 20:58:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 20:59:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 20:59:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 20:59:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 20:59:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:59:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:59:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:59:32 [WARNING ] (13, 1, 'bot')
2019-01-17 20:59:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 20:59:32 [DEBUG   ] Finished updating board flags in 1.744 seconds
2019-01-17 20:59:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 21:00:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 21:00:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 21:00:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:00:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:00:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:00:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:00:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:00:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:00:32 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-17 21:00:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 21:01:05 [DEBUG   ] Got command RPT from MCS: ref #1199960
2019-01-17 21:01:05 [DEBUG   ] summary = ERROR
2019-01-17 21:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199960  13 58500 75665761 A  ERRORERROR'
2019-01-17 21:01:05 [DEBUG   ] Got command RPT from MCS: ref #1199961
2019-01-17 21:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199961  77 58500 75665762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:01:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 21:01:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 21:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:01:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:01:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:01:32 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-17 21:01:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 21:02:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 21:02:15 [DEBUG   ] Got command RPT from MCS: ref #1199977
2019-01-17 21:02:15 [DEBUG   ] summary = ERROR
2019-01-17 21:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199977  13 58500 75735381 A  ERRORERROR'
2019-01-17 21:02:15 [DEBUG   ] Got command RPT from MCS: ref #1199978
2019-01-17 21:02:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199978  77 58500 75735573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:02:15 [DEBUG   ] Got command RPT from MCS: ref #1199979
2019-01-17 21:02:15 [DEBUG   ] summary = ERROR
2019-01-17 21:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199979  13 58500 75735777 A  ERRORERROR'
2019-01-17 21:02:15 [DEBUG   ] Got command RPT from MCS: ref #1199980
2019-01-17 21:02:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199980  77 58500 75735981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:02:16 [DEBUG   ] Got command RPT from MCS: ref #1199981
2019-01-17 21:02:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:02:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199981  12 58500 75736185 A  ERRORB”™š'
2019-01-17 21:02:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 21:02:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:02:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:02:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:02:32 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-17 21:02:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 21:03:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 21:03:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-17 21:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:03:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:03:32 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-17 21:03:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 21:04:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:04:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:04:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:04:32 [WARNING ] (13, 1, 'bot')
2019-01-17 21:04:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:04:32 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-01-17 21:04:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 21:05:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 21:05:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:05:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:05:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:05:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:05:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:05:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:05:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:05:33 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-01-17 21:05:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 21:06:05 [DEBUG   ] Got command RPT from MCS: ref #1199986
2019-01-17 21:06:05 [DEBUG   ] summary = ERROR
2019-01-17 21:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199986  13 58500 75965753 A  ERRORERROR'
2019-01-17 21:06:05 [DEBUG   ] Got command RPT from MCS: ref #1199987
2019-01-17 21:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1199987  77 58500 75965754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:06:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 21:06:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 21:06:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:06:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:06:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:06:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:06:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:06:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:06:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:06:33 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-17 21:06:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 21:07:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 21:07:15 [DEBUG   ] Got command RPT from MCS: ref #1200009
2019-01-17 21:07:15 [DEBUG   ] summary = ERROR
2019-01-17 21:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200009  13 58500 76035461 A  ERRORERROR'
2019-01-17 21:07:15 [DEBUG   ] Got command RPT from MCS: ref #1200010
2019-01-17 21:07:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200010  77 58500 76035653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:07:15 [DEBUG   ] Got command RPT from MCS: ref #1200011
2019-01-17 21:07:15 [DEBUG   ] summary = ERROR
2019-01-17 21:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200011  13 58500 76035857 A  ERRORERROR'
2019-01-17 21:07:16 [DEBUG   ] Got command RPT from MCS: ref #1200013
2019-01-17 21:07:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200013  77 58500 76036061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:07:16 [DEBUG   ] Got command RPT from MCS: ref #1200014
2019-01-17 21:07:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200014  12 58500 76036265 A  ERRORB”™š'
2019-01-17 21:07:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 21:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:07:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:07:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:07:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:07:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:07:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:07:33 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-17 21:07:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 21:08:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 21:08:29 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-17 21:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:08:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:08:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:08:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:08:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:08:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:08:33 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-17 21:08:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 21:09:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 21:09:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:09:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:09:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:09:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:09:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:09:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:09:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:09:33 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-17 21:09:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 21:10:09 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-17 21:10:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:10:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:10:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:10:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:10:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:10:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:10:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:10:33 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-17 21:10:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:11:05 [DEBUG   ] Got command RPT from MCS: ref #1200023
2019-01-17 21:11:05 [DEBUG   ] summary = ERROR
2019-01-17 21:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200023  13 58500 76265757 A  ERRORERROR'
2019-01-17 21:11:05 [DEBUG   ] Got command RPT from MCS: ref #1200024
2019-01-17 21:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200024  77 58500 76265758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:11:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 21:11:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 21:11:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:11:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:11:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:11:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:11:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:11:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:11:33 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-17 21:11:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 21:12:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-17 21:12:15 [DEBUG   ] Got command RPT from MCS: ref #1200040
2019-01-17 21:12:15 [DEBUG   ] summary = ERROR
2019-01-17 21:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200040  13 58500 76335533 A  ERRORERROR'
2019-01-17 21:12:15 [DEBUG   ] Got command RPT from MCS: ref #1200041
2019-01-17 21:12:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200041  77 58500 76335737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:12:15 [DEBUG   ] Got command RPT from MCS: ref #1200042
2019-01-17 21:12:15 [DEBUG   ] summary = ERROR
2019-01-17 21:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200042  13 58500 76335941 A  ERRORERROR'
2019-01-17 21:12:16 [DEBUG   ] Got command RPT from MCS: ref #1200043
2019-01-17 21:12:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:12:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200043  77 58500 76336145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:12:16 [DEBUG   ] Got command RPT from MCS: ref #1200044
2019-01-17 21:12:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:12:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200044  12 58500 76336337 A  ERRORB•™š'
2019-01-17 21:12:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 21:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:12:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:12:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:12:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:12:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:12:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:12:33 [DEBUG   ] Finished updating board flags in 1.577 seconds
2019-01-17 21:12:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 21:13:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 21:13:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 21:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:13:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:13:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:13:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:13:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:13:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:13:33 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-17 21:13:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 21:14:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:14:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 21:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:14:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:14:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:14:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:14:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:14:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:14:33 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-01-17 21:14:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 21:15:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 21:15:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:15:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:15:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:15:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:15:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:15:33 [WARNING ] (13, 1, 'bot')
2019-01-17 21:15:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:15:33 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-17 21:15:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 21:16:05 [DEBUG   ] Got command RPT from MCS: ref #1200053
2019-01-17 21:16:05 [DEBUG   ] summary = ERROR
2019-01-17 21:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200053  13 58500 76565761 A  ERRORERROR'
2019-01-17 21:16:05 [DEBUG   ] Got command RPT from MCS: ref #1200054
2019-01-17 21:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200054  77 58500 76565762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:16:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 21:16:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 21:16:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:16:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:16:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:16:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:16:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:16:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:16:34 [DEBUG   ] Finished updating board flags in 2.070 seconds
2019-01-17 21:16:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 21:17:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 21:17:15 [DEBUG   ] Got command RPT from MCS: ref #1200072
2019-01-17 21:17:15 [DEBUG   ] summary = ERROR
2019-01-17 21:17:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200072  13 58500 76635613 A  ERRORERROR'
2019-01-17 21:17:15 [DEBUG   ] Got command RPT from MCS: ref #1200073
2019-01-17 21:17:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:17:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200073  77 58500 76635817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:17:16 [DEBUG   ] Got command RPT from MCS: ref #1200074
2019-01-17 21:17:16 [DEBUG   ] summary = ERROR
2019-01-17 21:17:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200074  13 58500 76636021 A  ERRORERROR'
2019-01-17 21:17:16 [DEBUG   ] Got command RPT from MCS: ref #1200076
2019-01-17 21:17:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:17:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200076  77 58500 76636225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:17:16 [DEBUG   ] Got command RPT from MCS: ref #1200077
2019-01-17 21:17:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:17:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200077  12 58500 76636417 A  ERRORB˜™š'
2019-01-17 21:17:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-17 21:17:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 21:17:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:17:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:17:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:17:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:17:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:17:34 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-17 21:17:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 21:18:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 21:18:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 21:18:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 21:18:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:18:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:18:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:18:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:18:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:18:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:18:34 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-17 21:18:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 21:19:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 21:19:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 21:19:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:19:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:19:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:19:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:19:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:19:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:19:34 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-17 21:19:51 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-01-17 21:20:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:20:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:20:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 21:20:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:20:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:20:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:20:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:20:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:20:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:20:34 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-17 21:20:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 21:21:05 [DEBUG   ] Got command RPT from MCS: ref #1200086
2019-01-17 21:21:05 [DEBUG   ] summary = ERROR
2019-01-17 21:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200086  13 58500 76865757 A  ERRORERROR'
2019-01-17 21:21:05 [DEBUG   ] Got command RPT from MCS: ref #1200087
2019-01-17 21:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200087  77 58500 76865758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:21:11 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-17 21:21:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:21:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:21:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:21:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:21:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:21:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:21:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:21:34 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-17 21:21:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:22:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 21:22:15 [DEBUG   ] Got command RPT from MCS: ref #1200107
2019-01-17 21:22:15 [DEBUG   ] summary = ERROR
2019-01-17 21:22:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200107  13 58500 76935693 A  ERRORERROR'
2019-01-17 21:22:15 [DEBUG   ] Got command RPT from MCS: ref #1200108
2019-01-17 21:22:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:22:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200108  77 58500 76935897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:22:16 [DEBUG   ] Got command RPT from MCS: ref #1200109
2019-01-17 21:22:16 [DEBUG   ] summary = ERROR
2019-01-17 21:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200109  13 58500 76936101 A  ERRORERROR'
2019-01-17 21:22:16 [DEBUG   ] Got command RPT from MCS: ref #1200110
2019-01-17 21:22:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200110  77 58500 76936305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:22:16 [DEBUG   ] Got command RPT from MCS: ref #1200111
2019-01-17 21:22:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200111  12 58500 76936497 A  ERRORB—™š'
2019-01-17 21:22:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 21:22:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:22:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 21:22:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:22:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:22:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:22:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:22:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:22:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:22:34 [DEBUG   ] Finished updating board flags in 1.488 seconds
2019-01-17 21:22:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 21:23:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 21:23:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 21:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:23:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:23:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:23:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:23:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:23:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:23:34 [DEBUG   ] Finished updating board flags in 1.446 seconds
2019-01-17 21:23:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 21:24:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 21:24:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 21:24:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 21:24:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:24:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:24:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:24:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:24:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:24:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:24:34 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-17 21:24:51 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-17 21:25:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 21:25:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 21:25:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:25:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 21:25:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:25:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:25:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:25:34 [WARNING ] (13, 1, 'bot')
2019-01-17 21:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:25:34 [DEBUG   ] Finished updating board flags in 1.453 seconds
2019-01-17 21:25:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 21:26:05 [DEBUG   ] Got command RPT from MCS: ref #1200116
2019-01-17 21:26:05 [DEBUG   ] summary = ERROR
2019-01-17 21:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200116  13 58500 77165765 A  ERRORERROR'
2019-01-17 21:26:05 [DEBUG   ] Got command RPT from MCS: ref #1200117
2019-01-17 21:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200117  77 58500 77165766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:26:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 21:26:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:26:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 21:26:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:26:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:26:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:26:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:26:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:26:35 [DEBUG   ] Finished updating board flags in 2.262 seconds
2019-01-17 21:26:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 21:27:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 21:27:15 [DEBUG   ] Got command RPT from MCS: ref #1200135
2019-01-17 21:27:15 [DEBUG   ] summary = ERROR
2019-01-17 21:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200135  13 58500 77235781 A  ERRORERROR'
2019-01-17 21:27:15 [DEBUG   ] Got command RPT from MCS: ref #1200136
2019-01-17 21:27:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200136  77 58500 77235985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:27:16 [DEBUG   ] Got command RPT from MCS: ref #1200137
2019-01-17 21:27:16 [DEBUG   ] summary = ERROR
2019-01-17 21:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200137  13 58500 77236177 A  ERRORERROR'
2019-01-17 21:27:16 [DEBUG   ] Got command RPT from MCS: ref #1200139
2019-01-17 21:27:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200139  77 58500 77236381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:27:16 [DEBUG   ] Got command RPT from MCS: ref #1200140
2019-01-17 21:27:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200140  12 58500 77236585 A  ERRORB—™š'
2019-01-17 21:27:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 21:27:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:27:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:27:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:27:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:27:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:27:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:27:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:27:35 [DEBUG   ] Finished updating board flags in 2.126 seconds
2019-01-17 21:27:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:28:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:28:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 21:28:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:28:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:28:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:28:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:28:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:28:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:28:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:28:35 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-17 21:28:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 21:29:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 21:29:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 21:29:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:29:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:29:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:29:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:29:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:29:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:29:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:29:35 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-17 21:29:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 21:30:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 21:30:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 21:30:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:30:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:30:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:30:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:30:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:30:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:30:35 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-17 21:30:53 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-17 21:31:05 [DEBUG   ] Got command RPT from MCS: ref #1200153
2019-01-17 21:31:05 [DEBUG   ] summary = ERROR
2019-01-17 21:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200153  13 58500 77465757 A  ERRORERROR'
2019-01-17 21:31:05 [DEBUG   ] Got command RPT from MCS: ref #1200154
2019-01-17 21:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200154  77 58500 77465758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:31:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 21:31:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 21:31:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:31:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:31:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:31:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:31:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:31:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:31:35 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-17 21:31:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 21:32:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 21:32:15 [DEBUG   ] Got command RPT from MCS: ref #1200170
2019-01-17 21:32:15 [DEBUG   ] summary = ERROR
2019-01-17 21:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200170  13 58500 77535857 A  ERRORERROR'
2019-01-17 21:32:16 [DEBUG   ] Got command RPT from MCS: ref #1200171
2019-01-17 21:32:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:32:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200171  77 58500 77536061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:32:16 [DEBUG   ] Got command RPT from MCS: ref #1200172
2019-01-17 21:32:16 [DEBUG   ] summary = ERROR
2019-01-17 21:32:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200172  13 58500 77536265 A  ERRORERROR'
2019-01-17 21:32:16 [DEBUG   ] Got command RPT from MCS: ref #1200173
2019-01-17 21:32:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:32:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200173  77 58500 77536457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:32:16 [DEBUG   ] Got command RPT from MCS: ref #1200174
2019-01-17 21:32:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:32:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200174  12 58500 77536661 A  ERRORB–™š'
2019-01-17 21:32:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 21:32:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:32:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 21:32:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:32:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:32:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:32:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:32:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:32:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:32:35 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-17 21:32:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:33:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:33:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 21:33:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:33:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:33:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:33:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:33:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:33:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:33:35 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-17 21:33:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 21:34:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:34:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:34:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 21:34:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:34:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:34:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:34:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:34:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:34:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:34:35 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-17 21:34:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 21:35:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 21:35:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 21:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:35:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 21:35:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:35:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:35:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:35:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:35:35 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-17 21:35:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1200179
2019-01-17 21:36:05 [DEBUG   ] summary = ERROR
2019-01-17 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200179  13 58500 77765757 A  ERRORERROR'
2019-01-17 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1200180
2019-01-17 21:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200180  77 58500 77765758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:36:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 21:36:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 21:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:36:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 21:36:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:36:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:36:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:36:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:36:35 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-01-17 21:36:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 21:37:14 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-17 21:37:15 [DEBUG   ] Got command RPT from MCS: ref #1200202
2019-01-17 21:37:15 [DEBUG   ] summary = ERROR
2019-01-17 21:37:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200202  13 58500 77835941 A  ERRORERROR'
2019-01-17 21:37:16 [DEBUG   ] Got command RPT from MCS: ref #1200203
2019-01-17 21:37:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200203  77 58500 77836145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:37:16 [DEBUG   ] Got command RPT from MCS: ref #1200204
2019-01-17 21:37:16 [DEBUG   ] summary = ERROR
2019-01-17 21:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200204  13 58500 77836337 A  ERRORERROR'
2019-01-17 21:37:16 [DEBUG   ] Got command RPT from MCS: ref #1200206
2019-01-17 21:37:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200206  77 58500 77836541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:37:16 [DEBUG   ] Got command RPT from MCS: ref #1200208
2019-01-17 21:37:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200208  12 58500 77836745 A  ERRORB–™š'
2019-01-17 21:37:33 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-17 21:37:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:37:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:37:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:37:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:37:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:37:35 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-01-17 21:37:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-01-17 21:38:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 21:38:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 21:38:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:38:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:38:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:38:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:38:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:38:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:38:35 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-17 21:38:54 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-17 21:39:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:39:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 21:39:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:39:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:39:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:39:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:39:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:39:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:39:35 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-17 21:39:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 21:40:14 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-17 21:40:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:40:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:40:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:40:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:40:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:40:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:40:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:40:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:40:35 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-17 21:40:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1200216
2019-01-17 21:41:05 [DEBUG   ] summary = ERROR
2019-01-17 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200216  13 58500 78065769 A  ERRORERROR'
2019-01-17 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1200217
2019-01-17 21:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200217  77 58500 78065770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:41:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 21:41:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 21:41:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:41:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:41:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:41:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:41:35 [WARNING ] (13, 1, 'bot')
2019-01-17 21:41:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:41:35 [DEBUG   ] Finished updating board flags in 1.452 seconds
2019-01-17 21:41:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 21:42:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 21:42:16 [DEBUG   ] Got command RPT from MCS: ref #1200233
2019-01-17 21:42:16 [DEBUG   ] summary = ERROR
2019-01-17 21:42:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200233  13 58500 78136025 A  ERRORERROR'
2019-01-17 21:42:16 [DEBUG   ] Got command RPT from MCS: ref #1200234
2019-01-17 21:42:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:42:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200234  77 58500 78136217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:42:16 [DEBUG   ] Got command RPT from MCS: ref #1200235
2019-01-17 21:42:16 [DEBUG   ] summary = ERROR
2019-01-17 21:42:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200235  13 58500 78136421 A  ERRORERROR'
2019-01-17 21:42:16 [DEBUG   ] Got command RPT from MCS: ref #1200236
2019-01-17 21:42:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:42:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200236  77 58500 78136625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:42:16 [DEBUG   ] Got command RPT from MCS: ref #1200237
2019-01-17 21:42:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:42:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200237  12 58500 78136817 A  ERRORB•™š'
2019-01-17 21:42:35 [DEBUG   ] Finished updating ant stats in 1.256 seconds
2019-01-17 21:42:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:42:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:42:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:42:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:42:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:42:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:42:36 [DEBUG   ] Finished updating board flags in 2.239 seconds
2019-01-17 21:42:55 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2019-01-17 21:43:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 21:43:35 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2019-01-17 21:43:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:43:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:43:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:43:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:43:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:43:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:43:36 [DEBUG   ] Finished updating board flags in 2.132 seconds
2019-01-17 21:43:55 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2019-01-17 21:44:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:44:35 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2019-01-17 21:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:44:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:44:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:44:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:44:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:44:36 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-17 21:44:55 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2019-01-17 21:45:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 21:45:35 [DEBUG   ] Finished updating ant stats in 0.450 seconds
2019-01-17 21:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:45:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:45:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:45:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:45:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:45:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:45:36 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-17 21:45:56 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2019-01-17 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1200246
2019-01-17 21:46:05 [DEBUG   ] summary = ERROR
2019-01-17 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200246  13 58500 78365765 A  ERRORERROR'
2019-01-17 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1200247
2019-01-17 21:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200247  77 58500 78365766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:46:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 21:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:46:36 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2019-01-17 21:46:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:46:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:46:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:46:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:46:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:46:36 [DEBUG   ] Finished updating board flags in 1.881 seconds
2019-01-17 21:46:56 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2019-01-17 21:47:16 [DEBUG   ] Got command RPT from MCS: ref #1200265
2019-01-17 21:47:16 [DEBUG   ] summary = ERROR
2019-01-17 21:47:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200265  13 58500 78436117 A  ERRORERROR'
2019-01-17 21:47:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 21:47:16 [DEBUG   ] Got command RPT from MCS: ref #1200266
2019-01-17 21:47:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:47:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200266  77 58500 78436321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:47:16 [DEBUG   ] Got command RPT from MCS: ref #1200267
2019-01-17 21:47:16 [DEBUG   ] summary = ERROR
2019-01-17 21:47:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200267  13 58500 78436525 A  ERRORERROR'
2019-01-17 21:47:16 [DEBUG   ] Got command RPT from MCS: ref #1200269
2019-01-17 21:47:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:47:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200269  77 58500 78436717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:47:16 [DEBUG   ] Got command RPT from MCS: ref #1200270
2019-01-17 21:47:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:47:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200270  12 58500 78436921 A  ERRORB•™š'
2019-01-17 21:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:47:36 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-01-17 21:47:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:47:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:47:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:47:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:47:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:47:36 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-01-17 21:47:56 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2019-01-17 21:48:17 [DEBUG   ] Finished updating ant stats in 1.500 seconds
2019-01-17 21:48:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:48:36 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2019-01-17 21:48:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:48:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:48:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:48:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:48:36 [DEBUG   ] Finished updating board flags in 1.506 seconds
2019-01-17 21:48:57 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2019-01-17 21:49:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 21:49:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:49:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:49:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:49:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:49:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:49:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:49:36 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-01-17 21:49:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 21:49:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 21:50:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:50:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:50:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:50:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:50:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:50:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:50:36 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-17 21:50:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 21:50:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1200279
2019-01-17 21:51:05 [DEBUG   ] summary = ERROR
2019-01-17 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200279  13 58500 78665769 A  ERRORERROR'
2019-01-17 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1200280
2019-01-17 21:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200280  77 58500 78665770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:51:17 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-17 21:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:51:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:51:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:51:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:51:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:51:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:51:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:51:36 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-17 21:51:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 21:51:57 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 21:52:16 [DEBUG   ] Got command RPT from MCS: ref #1200300
2019-01-17 21:52:16 [DEBUG   ] summary = ERROR
2019-01-17 21:52:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200300  13 58500 78736201 A  ERRORERROR'
2019-01-17 21:52:16 [DEBUG   ] Got command RPT from MCS: ref #1200301
2019-01-17 21:52:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:52:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200301  77 58500 78736393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:52:16 [DEBUG   ] Got command RPT from MCS: ref #1200302
2019-01-17 21:52:16 [DEBUG   ] summary = ERROR
2019-01-17 21:52:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200302  13 58500 78736597 A  ERRORERROR'
2019-01-17 21:52:16 [DEBUG   ] Got command RPT from MCS: ref #1200303
2019-01-17 21:52:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:52:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200303  77 58500 78736802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:52:17 [DEBUG   ] Got command RPT from MCS: ref #1200304
2019-01-17 21:52:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:52:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200304  12 58500 78737005 A  ERRORB•™š'
2019-01-17 21:52:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 21:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:52:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:52:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:52:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:52:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:52:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:52:36 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-17 21:52:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 21:52:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 21:53:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 21:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:53:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:53:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:53:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:53:36 [WARNING ] (13, 1, 'bot')
2019-01-17 21:53:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:53:36 [DEBUG   ] Finished updating board flags in 1.329 seconds
2019-01-17 21:53:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 21:53:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 21:54:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 21:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:54:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:54:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:54:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:54:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:54:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:54:37 [DEBUG   ] Finished updating board flags in 2.153 seconds
2019-01-17 21:54:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 21:54:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:55:18 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2019-01-17 21:55:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:55:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 21:55:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:55:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:55:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:55:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:55:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:55:37 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-17 21:55:38 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-17 21:55:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1200309
2019-01-17 21:56:05 [DEBUG   ] summary = ERROR
2019-01-17 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200309  13 58500 78965769 A  ERRORERROR'
2019-01-17 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1200310
2019-01-17 21:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200310  77 58500 78965770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:56:19 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-17 21:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:56:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:56:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:56:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:56:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:56:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:56:37 [DEBUG   ] Finished updating board flags in 1.959 seconds
2019-01-17 21:56:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 21:56:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 21:57:16 [DEBUG   ] Got command RPT from MCS: ref #1200328
2019-01-17 21:57:16 [DEBUG   ] summary = ERROR
2019-01-17 21:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200328  13 58500 79036281 A  ERRORERROR'
2019-01-17 21:57:16 [DEBUG   ] Got command RPT from MCS: ref #1200329
2019-01-17 21:57:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200329  77 58500 79036473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:57:16 [DEBUG   ] Got command RPT from MCS: ref #1200330
2019-01-17 21:57:16 [DEBUG   ] summary = ERROR
2019-01-17 21:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200330  13 58500 79036677 A  ERRORERROR'
2019-01-17 21:57:16 [DEBUG   ] Got command RPT from MCS: ref #1200332
2019-01-17 21:57:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 21:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200332  77 58500 79036881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 21:57:17 [DEBUG   ] Got command RPT from MCS: ref #1200334
2019-01-17 21:57:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 21:57:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200334  12 58500 79037085 A  ERRORB•™š'
2019-01-17 21:57:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 21:57:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:57:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 21:57:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:57:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:57:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:57:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:57:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:57:37 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-17 21:57:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 21:57:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 21:58:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 21:58:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:58:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:58:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:58:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:58:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:58:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:58:37 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-17 21:58:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 21:58:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 21:59:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 21:59:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 21:59:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:59:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:59:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:59:37 [WARNING ] (13, 1, 'bot')
2019-01-17 21:59:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 21:59:37 [DEBUG   ] Finished updating board flags in 1.660 seconds
2019-01-17 21:59:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 21:59:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 22:00:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:00:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:00:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:00:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:00:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:00:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:00:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:00:37 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-01-17 22:00:39 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-17 22:00:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1200346
2019-01-17 22:01:05 [DEBUG   ] summary = ERROR
2019-01-17 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200346  13 58500 79265769 A  ERRORERROR'
2019-01-17 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1200347
2019-01-17 22:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200347  77 58500 79265770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:01:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:01:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:01:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:01:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:01:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:01:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:01:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:01:37 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-17 22:01:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 22:01:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 22:02:16 [DEBUG   ] Got command RPT from MCS: ref #1200363
2019-01-17 22:02:16 [DEBUG   ] summary = ERROR
2019-01-17 22:02:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200363  13 58500 79336357 A  ERRORERROR'
2019-01-17 22:02:16 [DEBUG   ] Got command RPT from MCS: ref #1200364
2019-01-17 22:02:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:02:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200364  77 58500 79336561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:02:16 [DEBUG   ] Got command RPT from MCS: ref #1200365
2019-01-17 22:02:16 [DEBUG   ] summary = ERROR
2019-01-17 22:02:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200365  13 58500 79336765 A  ERRORERROR'
2019-01-17 22:02:16 [DEBUG   ] Got command RPT from MCS: ref #1200366
2019-01-17 22:02:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:02:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200366  77 58500 79336957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:02:17 [DEBUG   ] Got command RPT from MCS: ref #1200367
2019-01-17 22:02:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:02:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200367  12 58500 79337161 A  ERRORB•™š'
2019-01-17 22:02:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 22:02:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:02:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:02:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:02:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:02:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:02:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:02:37 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-17 22:02:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 22:02:59 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-17 22:03:19 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-17 22:03:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:03:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:03:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:03:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:03:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:03:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:03:37 [DEBUG   ] Finished updating board flags in 1.471 seconds
2019-01-17 22:03:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 22:04:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 22:04:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 22:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:04:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:04:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:04:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:04:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:04:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:04:37 [DEBUG   ] Finished updating board flags in 1.470 seconds
2019-01-17 22:04:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 22:05:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:05:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 22:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:05:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:05:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:05:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:05:37 [WARNING ] (13, 1, 'bot')
2019-01-17 22:05:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:05:37 [DEBUG   ] Finished updating board flags in 1.474 seconds
2019-01-17 22:05:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:06:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:06:05 [DEBUG   ] Got command RPT from MCS: ref #1200372
2019-01-17 22:06:05 [DEBUG   ] summary = ERROR
2019-01-17 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200372  13 58500 79565765 A  ERRORERROR'
2019-01-17 22:06:05 [DEBUG   ] Got command RPT from MCS: ref #1200373
2019-01-17 22:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200373  77 58500 79565766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:06:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 22:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:06:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 22:06:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:06:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:06:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:06:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:06:38 [DEBUG   ] Finished updating board flags in 2.238 seconds
2019-01-17 22:06:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 22:07:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 22:07:16 [DEBUG   ] Got command RPT from MCS: ref #1200395
2019-01-17 22:07:16 [DEBUG   ] summary = ERROR
2019-01-17 22:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200395  13 58500 79636441 A  ERRORERROR'
2019-01-17 22:07:16 [DEBUG   ] Got command RPT from MCS: ref #1200396
2019-01-17 22:07:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200396  77 58500 79636633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:07:16 [DEBUG   ] Got command RPT from MCS: ref #1200397
2019-01-17 22:07:16 [DEBUG   ] summary = ERROR
2019-01-17 22:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200397  13 58500 79636837 A  ERRORERROR'
2019-01-17 22:07:17 [DEBUG   ] Got command RPT from MCS: ref #1200399
2019-01-17 22:07:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200399  77 58500 79637041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:07:17 [DEBUG   ] Got command RPT from MCS: ref #1200401
2019-01-17 22:07:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200401  12 58500 79637245 A  ERRORB•™š'
2019-01-17 22:07:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 22:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:07:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:07:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:07:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:07:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:07:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:07:38 [DEBUG   ] Finished updating board flags in 2.149 seconds
2019-01-17 22:07:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 22:08:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 22:08:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 22:08:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:08:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:08:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:08:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:08:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:08:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:08:38 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-01-17 22:08:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 22:09:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-17 22:09:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-17 22:09:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:09:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:09:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:09:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:09:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:09:38 [DEBUG   ] Finished updating board flags in 1.970 seconds
2019-01-17 22:09:41 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-17 22:10:01 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-01-17 22:10:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 22:10:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:10:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:10:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:10:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:10:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:10:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:10:38 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-17 22:10:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 22:11:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:11:05 [DEBUG   ] Got command RPT from MCS: ref #1200409
2019-01-17 22:11:05 [DEBUG   ] summary = ERROR
2019-01-17 22:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200409  13 58500 79865773 A  ERRORERROR'
2019-01-17 22:11:05 [DEBUG   ] Got command RPT from MCS: ref #1200410
2019-01-17 22:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200410  77 58500 79865774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:11:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:11:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:11:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:11:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:11:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:11:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:11:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:11:38 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-17 22:11:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:12:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 22:12:16 [DEBUG   ] Got command RPT from MCS: ref #1200426
2019-01-17 22:12:16 [DEBUG   ] summary = ERROR
2019-01-17 22:12:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200426  13 58500 79936513 A  ERRORERROR'
2019-01-17 22:12:16 [DEBUG   ] Got command RPT from MCS: ref #1200427
2019-01-17 22:12:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:12:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200427  77 58500 79936717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:12:16 [DEBUG   ] Got command RPT from MCS: ref #1200428
2019-01-17 22:12:16 [DEBUG   ] summary = ERROR
2019-01-17 22:12:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200428  13 58500 79936921 A  ERRORERROR'
2019-01-17 22:12:17 [DEBUG   ] Got command RPT from MCS: ref #1200429
2019-01-17 22:12:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200429  77 58500 79937125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:12:17 [DEBUG   ] Got command RPT from MCS: ref #1200430
2019-01-17 22:12:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200430  12 58500 79937317 A  ERRORB•™š'
2019-01-17 22:12:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 22:12:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:12:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:12:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:12:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:12:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:12:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:12:38 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-17 22:12:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 22:13:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-01-17 22:13:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 22:13:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:13:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:13:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:13:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:13:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:13:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:13:38 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-17 22:13:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 22:14:01 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-01-17 22:14:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 22:14:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:14:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:14:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:14:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:14:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:14:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:14:38 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-17 22:14:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 22:15:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 22:15:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 22:15:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:15:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:15:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:15:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:15:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:15:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:15:38 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-17 22:15:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 22:16:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 22:16:05 [DEBUG   ] Got command RPT from MCS: ref #1200439
2019-01-17 22:16:05 [DEBUG   ] summary = ERROR
2019-01-17 22:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200439  13 58500 80165773 A  ERRORERROR'
2019-01-17 22:16:05 [DEBUG   ] Got command RPT from MCS: ref #1200440
2019-01-17 22:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200440  77 58500 80165774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:16:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:16:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:16:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 22:16:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:16:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:16:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:16:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:16:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:16:38 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-17 22:16:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 22:17:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:17:16 [DEBUG   ] Got command RPT from MCS: ref #1200458
2019-01-17 22:17:16 [DEBUG   ] summary = ERROR
2019-01-17 22:17:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200458  13 58500 80236593 A  ERRORERROR'
2019-01-17 22:17:16 [DEBUG   ] Got command RPT from MCS: ref #1200459
2019-01-17 22:17:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:17:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200459  77 58500 80236797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:17:17 [DEBUG   ] Got command RPT from MCS: ref #1200460
2019-01-17 22:17:17 [DEBUG   ] summary = ERROR
2019-01-17 22:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200460  13 58500 80237001 A  ERRORERROR'
2019-01-17 22:17:17 [DEBUG   ] Got command RPT from MCS: ref #1200462
2019-01-17 22:17:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200462  77 58500 80237205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:17:17 [DEBUG   ] Got command RPT from MCS: ref #1200463
2019-01-17 22:17:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200463  12 58500 80237397 A  ERRORB•™š'
2019-01-17 22:17:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:17:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:17:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:17:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:17:38 [WARNING ] (13, 1, 'bot')
2019-01-17 22:17:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:17:38 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-01-17 22:17:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 22:18:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:18:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 22:18:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:18:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:18:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:18:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:18:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:18:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:18:39 [DEBUG   ] Finished updating board flags in 2.065 seconds
2019-01-17 22:18:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:19:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 22:19:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-17 22:19:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:19:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:19:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:19:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:19:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:19:39 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-17 22:19:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 22:20:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 22:20:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 22:20:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:20:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:20:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:20:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:20:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:20:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:20:39 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-17 22:20:42 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2019-01-17 22:21:03 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 22:21:05 [DEBUG   ] Got command RPT from MCS: ref #1200472
2019-01-17 22:21:05 [DEBUG   ] summary = ERROR
2019-01-17 22:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200472  13 58500 80465769 A  ERRORERROR'
2019-01-17 22:21:05 [DEBUG   ] Got command RPT from MCS: ref #1200473
2019-01-17 22:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200473  77 58500 80465770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:21:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 22:21:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:21:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:21:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:21:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:21:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:21:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:21:39 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-17 22:21:43 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-17 22:22:00 [DEBUG   ] Got command TBN from MCS: ref #1200493
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-17 22:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1200493   8 58500 80520494 A  ERROR'
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547763721']
2019-01-17 22:22:00 [DEBUG   ] spawn_process: at 2019-01-17 22:22:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547763721']
2019-01-17 22:22:00 [INFO    ] Finished spawning TBN in 0.043 s
2019-01-17 22:22:03 [DEBUG   ] Finished updating ant stats in 0.937 seconds
2019-01-17 22:22:16 [DEBUG   ] Got command RPT from MCS: ref #1200494
2019-01-17 22:22:16 [DEBUG   ] summary = ERROR
2019-01-17 22:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200494  13 58500 80536681 A  ERRORERROR'
2019-01-17 22:22:16 [DEBUG   ] Got command RPT from MCS: ref #1200495
2019-01-17 22:22:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200495  77 58500 80536885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:22:17 [DEBUG   ] Got command RPT from MCS: ref #1200496
2019-01-17 22:22:17 [DEBUG   ] summary = ERROR
2019-01-17 22:22:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200496  13 58500 80537081 A  ERRORERROR'
2019-01-17 22:22:17 [DEBUG   ] Got command RPT from MCS: ref #1200497
2019-01-17 22:22:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:22:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200497  77 58500 80537285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:22:17 [DEBUG   ] Got command RPT from MCS: ref #1200498
2019-01-17 22:22:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:22:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200498  12 58500 80537546 A  ERRORB•™š'
2019-01-17 22:22:23 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2019-01-17 22:22:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:22:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:22:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:22:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:22:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:22:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:22:39 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-17 22:22:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:23:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 22:23:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:23:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:23:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:23:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:23:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:23:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:23:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:23:39 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-17 22:23:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 22:24:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 22:24:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 22:24:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:24:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:24:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:24:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:24:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:24:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:24:39 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-17 22:24:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 22:25:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-17 22:25:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 22:25:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:25:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:25:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:25:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:25:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:25:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:25:39 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-17 22:25:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 22:26:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 22:26:05 [DEBUG   ] Got command RPT from MCS: ref #1200503
2019-01-17 22:26:05 [DEBUG   ] summary = ERROR
2019-01-17 22:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200503  13 58500 80765773 A  ERRORERROR'
2019-01-17 22:26:05 [DEBUG   ] Got command RPT from MCS: ref #1200504
2019-01-17 22:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200504  77 58500 80765774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:26:11 [DEBUG   ] Got command TBW from MCS: ref #1200521
2019-01-17 22:26:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-17 22:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1200521   8 58500 80771561 A  ERROR'
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-17 22:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-17 22:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-17 22:26:15 [DEBUG   ] spawn_process: at 2019-01-17 22:26:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-17 22:26:15 [INFO    ] Finished spawning TBW
2019-01-17 22:26:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:26:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:26:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:26:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:26:39 [WARNING ] (13, 1, 'bot')
2019-01-17 22:26:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:26:39 [DEBUG   ] Finished updating board flags in 1.122 seconds
2019-01-17 22:27:16 [DEBUG   ] Got command RPT from MCS: ref #1200527
2019-01-17 22:27:16 [DEBUG   ] summary = ERROR
2019-01-17 22:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200527  13 58500 80836769 A  ERRORERROR'
2019-01-17 22:27:16 [DEBUG   ] Got command RPT from MCS: ref #1200528
2019-01-17 22:27:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200528  77 58500 80836961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:27:17 [DEBUG   ] Got command RPT from MCS: ref #1200529
2019-01-17 22:27:17 [DEBUG   ] summary = ERROR
2019-01-17 22:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200529  13 58500 80837165 A  ERRORERROR'
2019-01-17 22:27:17 [DEBUG   ] Got command RPT from MCS: ref #1200531
2019-01-17 22:27:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200531  77 58500 80837369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:27:17 [DEBUG   ] Got command RPT from MCS: ref #1200533
2019-01-17 22:27:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200533  12 58500 80837561 A  ERRORB”™š'
2019-01-17 22:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:27:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:27:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:27:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:27:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:27:40 [DEBUG   ] Finished updating board flags in 2.135 seconds
2019-01-17 22:28:03 [INFO    ] __waitForTBW - TBW finished in 108.820 s
2019-01-17 22:28:04 [DEBUG   ] Finished updating ant stats in 0.369 seconds
2019-01-17 22:28:04 [INFO    ] Started antennas statistics background thread
2019-01-17 22:28:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547764086']
2019-01-17 22:28:04 [DEBUG   ] spawn_process: at 2019-01-17 22:28:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547764086']
2019-01-17 22:28:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-17 22:28:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2019-01-17 22:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:28:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:28:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:28:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:28:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:28:40 [DEBUG   ] Finished updating board flags in 2.178 seconds
2019-01-17 22:28:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 22:29:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 22:29:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 22:29:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:29:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:29:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:29:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:29:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:29:40 [DEBUG   ] Finished updating board flags in 1.855 seconds
2019-01-17 22:29:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:30:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:30:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 22:30:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:30:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:30:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:30:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:30:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:30:40 [DEBUG   ] Finished updating board flags in 1.833 seconds
2019-01-17 22:30:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 22:31:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 22:31:05 [DEBUG   ] Got command RPT from MCS: ref #1200549
2019-01-17 22:31:05 [DEBUG   ] summary = ERROR
2019-01-17 22:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200549  13 58500 81065769 A  ERRORERROR'
2019-01-17 22:31:05 [DEBUG   ] Got command RPT from MCS: ref #1200550
2019-01-17 22:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200550  77 58500 81065770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:31:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 22:31:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:31:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:31:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:31:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:31:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:31:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:31:40 [DEBUG   ] Finished updating board flags in 1.769 seconds
2019-01-17 22:31:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 22:32:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 22:32:16 [DEBUG   ] Got command RPT from MCS: ref #1200566
2019-01-17 22:32:16 [DEBUG   ] summary = ERROR
2019-01-17 22:32:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200566  13 58500 81136841 A  ERRORERROR'
2019-01-17 22:32:17 [DEBUG   ] Got command RPT from MCS: ref #1200567
2019-01-17 22:32:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:32:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200567  77 58500 81137045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:32:17 [DEBUG   ] Got command RPT from MCS: ref #1200568
2019-01-17 22:32:17 [DEBUG   ] summary = ERROR
2019-01-17 22:32:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200568  13 58500 81137249 A  ERRORERROR'
2019-01-17 22:32:17 [DEBUG   ] Got command RPT from MCS: ref #1200569
2019-01-17 22:32:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:32:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200569  77 58500 81137453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:32:17 [DEBUG   ] Got command RPT from MCS: ref #1200570
2019-01-17 22:32:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:32:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200570  12 58500 81137645 A  ERRORB”™š'
2019-01-17 22:32:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 22:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:32:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:32:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:32:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:32:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:32:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:32:40 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-17 22:32:46 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-17 22:33:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 22:33:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:33:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:33:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 22:33:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:33:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:33:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:33:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:33:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:33:40 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-17 22:33:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 22:34:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:34:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:34:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:34:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:34:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:34:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:34:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:34:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:34:40 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-17 22:34:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:35:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 22:35:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 22:35:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 22:35:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:35:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:35:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:35:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:35:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:35:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:35:40 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-17 22:35:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:36:05 [DEBUG   ] Got command RPT from MCS: ref #1200575
2019-01-17 22:36:05 [DEBUG   ] summary = ERROR
2019-01-17 22:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200575  13 58500 81365774 A  ERRORERROR'
2019-01-17 22:36:05 [DEBUG   ] Got command RPT from MCS: ref #1200576
2019-01-17 22:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200576  77 58500 81365774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:36:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 22:36:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-17 22:36:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 22:36:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:36:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:36:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:36:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:36:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:36:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:36:40 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-01-17 22:36:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 22:37:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 22:37:16 [DEBUG   ] Got command RPT from MCS: ref #1200598
2019-01-17 22:37:16 [DEBUG   ] summary = ERROR
2019-01-17 22:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200598  13 58500 81436925 A  ERRORERROR'
2019-01-17 22:37:17 [DEBUG   ] Got command RPT from MCS: ref #1200599
2019-01-17 22:37:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:37:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200599  77 58500 81437129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:37:17 [DEBUG   ] Got command RPT from MCS: ref #1200600
2019-01-17 22:37:17 [DEBUG   ] summary = ERROR
2019-01-17 22:37:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200600  13 58500 81437321 A  ERRORERROR'
2019-01-17 22:37:17 [DEBUG   ] Got command RPT from MCS: ref #1200602
2019-01-17 22:37:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:37:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200602  77 58500 81437525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:37:17 [DEBUG   ] Got command RPT from MCS: ref #1200603
2019-01-17 22:37:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:37:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200603  12 58500 81437729 A  ERRORB–™š'
2019-01-17 22:37:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 22:37:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-17 22:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:37:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:37:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:37:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:37:40 [WARNING ] (13, 1, 'bot')
2019-01-17 22:37:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:37:40 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-17 22:37:47 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 22:38:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 22:38:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-17 22:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:38:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 22:38:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:38:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:38:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:38:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:38:41 [DEBUG   ] Finished updating board flags in 2.056 seconds
2019-01-17 22:38:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 22:39:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 22:39:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 22:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:39:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:39:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:39:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:39:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:39:41 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-17 22:39:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 22:40:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 22:40:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:40:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:40:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:40:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:40:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:40:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:40:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:40:41 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-17 22:40:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:41:05 [DEBUG   ] Got command RPT from MCS: ref #1200615
2019-01-17 22:41:05 [DEBUG   ] summary = ERROR
2019-01-17 22:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200615  13 58500 81665773 A  ERRORERROR'
2019-01-17 22:41:05 [DEBUG   ] Got command RPT from MCS: ref #1200616
2019-01-17 22:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200616  77 58500 81665774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:41:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-17 22:41:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 22:41:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:41:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:41:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:41:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:41:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:41:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:41:41 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-17 22:41:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:42:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:42:17 [DEBUG   ] Got command RPT from MCS: ref #1200634
2019-01-17 22:42:17 [DEBUG   ] summary = ERROR
2019-01-17 22:42:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200634  13 58500 81737009 A  ERRORERROR'
2019-01-17 22:42:17 [DEBUG   ] Got command RPT from MCS: ref #1200635
2019-01-17 22:42:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:42:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200635  77 58500 81737201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:42:17 [DEBUG   ] Got command RPT from MCS: ref #1200636
2019-01-17 22:42:17 [DEBUG   ] summary = ERROR
2019-01-17 22:42:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200636  13 58500 81737405 A  ERRORERROR'
2019-01-17 22:42:17 [DEBUG   ] Got command RPT from MCS: ref #1200637
2019-01-17 22:42:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:42:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200637  77 58500 81737609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:42:17 [DEBUG   ] Got command RPT from MCS: ref #1200638
2019-01-17 22:42:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:42:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200638  12 58500 81737813 A  ERRORB˜™š'
2019-01-17 22:42:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 22:42:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:42:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:42:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:42:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:42:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:42:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:42:41 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-17 22:42:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 22:43:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 22:43:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-17 22:43:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:43:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:43:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:43:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:43:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:43:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:43:41 [DEBUG   ] Finished updating board flags in 1.768 seconds
2019-01-17 22:43:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 22:44:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 22:44:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:44:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:44:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:44:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:44:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:44:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:44:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:44:41 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-17 22:44:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:45:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:45:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 22:45:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:45:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:45:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:45:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:45:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:45:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:45:41 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-17 22:45:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 22:46:05 [DEBUG   ] Got command RPT from MCS: ref #1200652
2019-01-17 22:46:05 [DEBUG   ] summary = ERROR
2019-01-17 22:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200652  13 58500 81965777 A  ERRORERROR'
2019-01-17 22:46:05 [DEBUG   ] Got command RPT from MCS: ref #1200653
2019-01-17 22:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200653  77 58500 81965778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:46:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 22:46:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 22:46:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:46:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 22:46:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:46:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:46:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:46:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:46:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:46:41 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-17 22:46:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 22:47:09 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-17 22:47:17 [DEBUG   ] Got command RPT from MCS: ref #1200671
2019-01-17 22:47:17 [DEBUG   ] summary = ERROR
2019-01-17 22:47:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200671  13 58500 82037085 A  ERRORERROR'
2019-01-17 22:47:17 [DEBUG   ] Got command RPT from MCS: ref #1200672
2019-01-17 22:47:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:47:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200672  77 58500 82037289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:47:17 [DEBUG   ] Got command RPT from MCS: ref #1200673
2019-01-17 22:47:17 [DEBUG   ] summary = ERROR
2019-01-17 22:47:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200673  13 58500 82037493 A  ERRORERROR'
2019-01-17 22:47:17 [DEBUG   ] Got command RPT from MCS: ref #1200675
2019-01-17 22:47:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:47:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200675  77 58500 82037685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:47:17 [DEBUG   ] Got command RPT from MCS: ref #1200677
2019-01-17 22:47:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:47:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200677  12 58500 82037889 A  ERRORB—™š'
2019-01-17 22:47:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 22:47:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:47:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:47:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:47:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:47:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:47:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:47:41 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-17 22:47:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:48:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:48:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:48:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:48:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:48:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:48:41 [WARNING ] (13, 1, 'bot')
2019-01-17 22:48:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:48:41 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-01-17 22:48:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 22:49:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 22:49:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 22:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:49:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:49:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:49:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:49:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:49:42 [DEBUG   ] Finished updating board flags in 2.052 seconds
2019-01-17 22:49:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 22:50:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 22:50:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 22:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:50:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:50:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:50:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:50:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:50:42 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-17 22:50:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 22:51:05 [DEBUG   ] Got command RPT from MCS: ref #1200685
2019-01-17 22:51:05 [DEBUG   ] summary = ERROR
2019-01-17 22:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200685  13 58500 82265773 A  ERRORERROR'
2019-01-17 22:51:05 [DEBUG   ] Got command RPT from MCS: ref #1200686
2019-01-17 22:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200686  77 58500 82265774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:51:10 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-17 22:51:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 22:51:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:51:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 22:51:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:51:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:51:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:51:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:51:42 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-17 22:51:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:52:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 22:52:17 [DEBUG   ] Got command RPT from MCS: ref #1200706
2019-01-17 22:52:17 [DEBUG   ] summary = ERROR
2019-01-17 22:52:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200706  13 58500 82337173 A  ERRORERROR'
2019-01-17 22:52:17 [DEBUG   ] Got command RPT from MCS: ref #1200707
2019-01-17 22:52:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:52:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200707  77 58500 82337365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:52:17 [DEBUG   ] Got command RPT from MCS: ref #1200708
2019-01-17 22:52:17 [DEBUG   ] summary = ERROR
2019-01-17 22:52:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200708  13 58500 82337569 A  ERRORERROR'
2019-01-17 22:52:17 [DEBUG   ] Got command RPT from MCS: ref #1200709
2019-01-17 22:52:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:52:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200709  77 58500 82337773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:52:17 [DEBUG   ] Got command RPT from MCS: ref #1200710
2019-01-17 22:52:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:52:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200710  12 58500 82337977 A  ERRORB—™š'
2019-01-17 22:52:30 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-17 22:52:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:52:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:52:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:52:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:52:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:52:42 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-17 22:52:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:53:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 22:53:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 22:53:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:53:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:53:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:53:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:53:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:53:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:53:42 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-17 22:53:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 22:54:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 22:54:30 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 22:54:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:54:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 22:54:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:54:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:54:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:54:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:54:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:54:42 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-17 22:54:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-17 22:55:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 22:55:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 22:55:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:55:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-17 22:55:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:55:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:55:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:55:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:55:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:55:42 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-17 22:55:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 22:56:05 [DEBUG   ] Got command RPT from MCS: ref #1200715
2019-01-17 22:56:05 [DEBUG   ] summary = ERROR
2019-01-17 22:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200715  13 58500 82565777 A  ERRORERROR'
2019-01-17 22:56:05 [DEBUG   ] Got command RPT from MCS: ref #1200716
2019-01-17 22:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200716  77 58500 82565778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:56:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 22:56:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 22:56:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:56:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:56:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:56:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:56:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:56:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:56:42 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-17 22:56:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 22:57:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 22:57:17 [DEBUG   ] Got command RPT from MCS: ref #1200734
2019-01-17 22:57:17 [DEBUG   ] summary = ERROR
2019-01-17 22:57:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200734  13 58500 82637253 A  ERRORERROR'
2019-01-17 22:57:17 [DEBUG   ] Got command RPT from MCS: ref #1200735
2019-01-17 22:57:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:57:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200735  77 58500 82637445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:57:17 [DEBUG   ] Got command RPT from MCS: ref #1200736
2019-01-17 22:57:17 [DEBUG   ] summary = ERROR
2019-01-17 22:57:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200736  13 58500 82637649 A  ERRORERROR'
2019-01-17 22:57:17 [DEBUG   ] Got command RPT from MCS: ref #1200738
2019-01-17 22:57:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 22:57:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200738  77 58500 82637853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 22:57:18 [DEBUG   ] Got command RPT from MCS: ref #1200739
2019-01-17 22:57:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 22:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200739  12 58500 82638057 A  ERRORB–™š'
2019-01-17 22:57:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 22:57:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:57:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:57:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:57:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:57:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:57:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:57:42 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-17 22:57:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 22:58:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 22:58:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 22:58:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:58:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:58:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:58:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:58:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:58:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:58:42 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-17 22:58:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 22:59:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 22:59:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 22:59:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 22:59:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:59:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:59:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:59:42 [WARNING ] (13, 1, 'bot')
2019-01-17 22:59:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 22:59:42 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-17 22:59:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 23:00:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 23:00:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 23:00:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:00:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:00:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:00:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:00:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:00:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:00:42 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-17 23:00:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 23:01:05 [DEBUG   ] Got command RPT from MCS: ref #1200752
2019-01-17 23:01:05 [DEBUG   ] summary = ERROR
2019-01-17 23:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200752  13 58500 82865781 A  ERRORERROR'
2019-01-17 23:01:05 [DEBUG   ] Got command RPT from MCS: ref #1200753
2019-01-17 23:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200753  77 58500 82865782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:01:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 23:01:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 23:01:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:01:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:01:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:01:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:01:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:01:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:01:42 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-01-17 23:01:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 23:02:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 23:02:17 [DEBUG   ] Got command RPT from MCS: ref #1200769
2019-01-17 23:02:17 [DEBUG   ] summary = ERROR
2019-01-17 23:02:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200769  13 58500 82937329 A  ERRORERROR'
2019-01-17 23:02:17 [DEBUG   ] Got command RPT from MCS: ref #1200770
2019-01-17 23:02:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:02:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200770  77 58500 82937533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:02:17 [DEBUG   ] Got command RPT from MCS: ref #1200771
2019-01-17 23:02:17 [DEBUG   ] summary = ERROR
2019-01-17 23:02:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200771  13 58500 82937737 A  ERRORERROR'
2019-01-17 23:02:17 [DEBUG   ] Got command RPT from MCS: ref #1200772
2019-01-17 23:02:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:02:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200772  77 58500 82937929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:02:18 [DEBUG   ] Got command RPT from MCS: ref #1200773
2019-01-17 23:02:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200773  12 58500 82938133 A  ERRORB–™š'
2019-01-17 23:02:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:02:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:02:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:02:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:02:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:02:42 [WARNING ] (13, 1, 'bot')
2019-01-17 23:02:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:02:42 [DEBUG   ] Finished updating board flags in 1.477 seconds
2019-01-17 23:02:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 23:03:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 23:03:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 23:03:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:03:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:03:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:03:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:03:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:03:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:03:43 [DEBUG   ] Finished updating board flags in 2.241 seconds
2019-01-17 23:03:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:04:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:04:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:04:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:04:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:04:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:04:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:04:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:04:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:04:43 [DEBUG   ] Finished updating board flags in 2.080 seconds
2019-01-17 23:04:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 23:05:12 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-17 23:05:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-17 23:05:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:05:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:05:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:05:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:05:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:05:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:05:43 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-17 23:05:53 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 23:06:05 [DEBUG   ] Got command RPT from MCS: ref #1200778
2019-01-17 23:06:05 [DEBUG   ] summary = ERROR
2019-01-17 23:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200778  13 58500 83165781 A  ERRORERROR'
2019-01-17 23:06:05 [DEBUG   ] Got command RPT from MCS: ref #1200779
2019-01-17 23:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200779  77 58500 83165782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:06:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 23:06:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 23:06:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:06:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:06:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:06:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:06:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:06:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:06:43 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-17 23:06:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 23:07:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 23:07:17 [DEBUG   ] Got command RPT from MCS: ref #1200801
2019-01-17 23:07:17 [DEBUG   ] summary = ERROR
2019-01-17 23:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200801  13 58500 83237413 A  ERRORERROR'
2019-01-17 23:07:17 [DEBUG   ] Got command RPT from MCS: ref #1200802
2019-01-17 23:07:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200802  77 58500 83237617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:07:17 [DEBUG   ] Got command RPT from MCS: ref #1200803
2019-01-17 23:07:17 [DEBUG   ] summary = ERROR
2019-01-17 23:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200803  13 58500 83237809 A  ERRORERROR'
2019-01-17 23:07:18 [DEBUG   ] Got command RPT from MCS: ref #1200805
2019-01-17 23:07:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200805  77 58500 83238013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:07:18 [DEBUG   ] Got command RPT from MCS: ref #1200807
2019-01-17 23:07:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200807  12 58500 83238217 A  ERRORB–™š'
2019-01-17 23:07:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 23:07:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:07:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:07:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:07:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:07:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:07:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:07:43 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-17 23:07:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:08:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:08:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 23:08:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:08:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:08:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:08:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:08:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:08:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:08:43 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-17 23:08:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:09:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 23:09:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 23:09:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:09:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:09:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:09:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:09:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:09:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:09:43 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-17 23:09:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 23:10:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 23:10:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 23:10:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:10:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:10:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:10:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:10:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:10:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:10:43 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-17 23:10:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 23:11:05 [DEBUG   ] Got command RPT from MCS: ref #1200815
2019-01-17 23:11:05 [DEBUG   ] summary = ERROR
2019-01-17 23:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200815  13 58500 83465781 A  ERRORERROR'
2019-01-17 23:11:05 [DEBUG   ] Got command RPT from MCS: ref #1200816
2019-01-17 23:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200816  77 58500 83465782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:11:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-17 23:11:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 23:11:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:11:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:11:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:11:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:11:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:11:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:11:43 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-17 23:11:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 23:12:14 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-17 23:12:17 [DEBUG   ] Got command RPT from MCS: ref #1200832
2019-01-17 23:12:17 [DEBUG   ] summary = ERROR
2019-01-17 23:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200832  13 58500 83537489 A  ERRORERROR'
2019-01-17 23:12:17 [DEBUG   ] Got command RPT from MCS: ref #1200833
2019-01-17 23:12:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200833  77 58500 83537693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:12:17 [DEBUG   ] Got command RPT from MCS: ref #1200834
2019-01-17 23:12:17 [DEBUG   ] summary = ERROR
2019-01-17 23:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200834  13 58500 83537897 A  ERRORERROR'
2019-01-17 23:12:18 [DEBUG   ] Got command RPT from MCS: ref #1200835
2019-01-17 23:12:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200835  77 58500 83538101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:12:18 [DEBUG   ] Got command RPT from MCS: ref #1200836
2019-01-17 23:12:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200836  12 58500 83538293 A  ERRORB•™š'
2019-01-17 23:12:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:12:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:12:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:12:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:12:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:12:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:12:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:12:43 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-17 23:12:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:13:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 23:13:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 23:13:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:13:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:13:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:13:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:13:43 [WARNING ] (13, 1, 'bot')
2019-01-17 23:13:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:13:43 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-17 23:13:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 23:14:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:14:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 23:14:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:14:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:14:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:14:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:14:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:14:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:14:44 [DEBUG   ] Finished updating board flags in 2.044 seconds
2019-01-17 23:14:54 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-17 23:15:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 23:15:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 23:15:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:15:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:15:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:15:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:15:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:15:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:15:44 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-17 23:15:54 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 23:16:05 [DEBUG   ] Got command RPT from MCS: ref #1200845
2019-01-17 23:16:05 [DEBUG   ] summary = ERROR
2019-01-17 23:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200845  13 58500 83765789 A  ERRORERROR'
2019-01-17 23:16:05 [DEBUG   ] Got command RPT from MCS: ref #1200846
2019-01-17 23:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200846  77 58500 83765790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:16:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 23:16:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 23:16:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:16:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:16:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:16:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:16:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:16:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:16:44 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-17 23:16:55 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-01-17 23:17:14 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2019-01-17 23:17:17 [DEBUG   ] Got command RPT from MCS: ref #1200864
2019-01-17 23:17:17 [DEBUG   ] summary = ERROR
2019-01-17 23:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200864  13 58500 83837577 A  ERRORERROR'
2019-01-17 23:17:17 [DEBUG   ] Got command RPT from MCS: ref #1200865
2019-01-17 23:17:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200865  77 58500 83837769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:17:17 [DEBUG   ] Got command RPT from MCS: ref #1200866
2019-01-17 23:17:17 [DEBUG   ] summary = ERROR
2019-01-17 23:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200866  13 58500 83837973 A  ERRORERROR'
2019-01-17 23:17:18 [DEBUG   ] Got command RPT from MCS: ref #1200868
2019-01-17 23:17:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200868  77 58500 83838177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:17:18 [DEBUG   ] Got command RPT from MCS: ref #1200869
2019-01-17 23:17:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200869  12 58500 83838381 A  ERRORB•™š'
2019-01-17 23:17:35 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-17 23:17:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:17:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:17:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:17:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:17:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:17:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:17:44 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-17 23:17:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 23:18:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 23:18:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 23:18:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:18:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:18:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:18:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:18:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:18:44 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-17 23:18:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 23:19:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:19:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 23:19:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:19:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 23:19:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:19:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:19:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:19:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:19:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:19:44 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-17 23:19:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 23:20:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 23:20:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 23:20:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:20:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:20:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:20:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:20:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:20:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:20:44 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-17 23:20:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 23:21:05 [DEBUG   ] Got command RPT from MCS: ref #1200878
2019-01-17 23:21:05 [DEBUG   ] summary = ERROR
2019-01-17 23:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200878  13 58500 84065785 A  ERRORERROR'
2019-01-17 23:21:05 [DEBUG   ] Got command RPT from MCS: ref #1200879
2019-01-17 23:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200879  77 58500 84065786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:21:15 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-17 23:21:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 23:21:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:21:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:21:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:21:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:21:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:21:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:21:44 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-17 23:21:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 23:22:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 23:22:17 [DEBUG   ] Got command RPT from MCS: ref #1200899
2019-01-17 23:22:17 [DEBUG   ] summary = ERROR
2019-01-17 23:22:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200899  13 58500 84137653 A  ERRORERROR'
2019-01-17 23:22:17 [DEBUG   ] Got command RPT from MCS: ref #1200900
2019-01-17 23:22:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:22:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200900  77 58500 84137857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:22:18 [DEBUG   ] Got command RPT from MCS: ref #1200901
2019-01-17 23:22:18 [DEBUG   ] summary = ERROR
2019-01-17 23:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200901  13 58500 84138061 A  ERRORERROR'
2019-01-17 23:22:18 [DEBUG   ] Got command RPT from MCS: ref #1200902
2019-01-17 23:22:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200902  77 58500 84138253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:22:18 [DEBUG   ] Got command RPT from MCS: ref #1200903
2019-01-17 23:22:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200903  12 58500 84138457 A  ERRORB•™š'
2019-01-17 23:22:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 23:22:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:22:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:22:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:22:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:22:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:22:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:22:44 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-17 23:22:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:23:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 23:23:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:23:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:23:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:23:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:23:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:23:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:23:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:23:44 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-17 23:23:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 23:24:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 23:24:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 23:24:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:24:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:24:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:24:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:24:44 [WARNING ] (13, 1, 'bot')
2019-01-17 23:24:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:24:44 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-17 23:24:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 23:25:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 23:25:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 23:25:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:25:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:25:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:25:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:25:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:25:45 [DEBUG   ] Finished updating board flags in 2.072 seconds
2019-01-17 23:25:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:26:05 [DEBUG   ] Got command RPT from MCS: ref #1200908
2019-01-17 23:26:05 [DEBUG   ] summary = ERROR
2019-01-17 23:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200908  13 58500 84365789 A  ERRORERROR'
2019-01-17 23:26:05 [DEBUG   ] Got command RPT from MCS: ref #1200909
2019-01-17 23:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200909  77 58500 84365790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:26:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:26:37 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 23:26:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:26:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:26:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:26:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:26:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:26:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:26:45 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-17 23:26:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 23:27:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:27:17 [DEBUG   ] Got command RPT from MCS: ref #1200927
2019-01-17 23:27:17 [DEBUG   ] summary = ERROR
2019-01-17 23:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200927  13 58500 84437729 A  ERRORERROR'
2019-01-17 23:27:17 [DEBUG   ] Got command RPT from MCS: ref #1200928
2019-01-17 23:27:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200928  77 58500 84437933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:27:18 [DEBUG   ] Got command RPT from MCS: ref #1200929
2019-01-17 23:27:18 [DEBUG   ] summary = ERROR
2019-01-17 23:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200929  13 58500 84438137 A  ERRORERROR'
2019-01-17 23:27:18 [DEBUG   ] Got command RPT from MCS: ref #1200931
2019-01-17 23:27:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200931  77 58500 84438329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:27:18 [DEBUG   ] Got command RPT from MCS: ref #1200932
2019-01-17 23:27:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200932  12 58500 84438533 A  ERRORB•™š'
2019-01-17 23:27:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 23:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:27:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 23:27:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:27:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:27:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:27:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:27:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:27:45 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-17 23:27:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:28:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 23:28:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 23:28:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:28:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:28:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:28:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:28:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:28:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:28:45 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-17 23:28:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 23:29:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 23:29:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 23:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:29:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:29:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:29:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:29:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:29:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:29:45 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-17 23:29:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-17 23:30:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 23:30:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 23:30:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:30:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:30:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:30:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:30:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:30:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:30:45 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-17 23:30:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:31:05 [DEBUG   ] Got command RPT from MCS: ref #1200945
2019-01-17 23:31:05 [DEBUG   ] summary = ERROR
2019-01-17 23:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200945  13 58500 84665789 A  ERRORERROR'
2019-01-17 23:31:05 [DEBUG   ] Got command RPT from MCS: ref #1200946
2019-01-17 23:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200946  77 58500 84665790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:31:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:31:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-17 23:31:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:31:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:31:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:31:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:31:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:31:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:31:45 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-17 23:31:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 23:32:17 [DEBUG   ] Got command RPT from MCS: ref #1200962
2019-01-17 23:32:17 [DEBUG   ] summary = ERROR
2019-01-17 23:32:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200962  13 58500 84737813 A  ERRORERROR'
2019-01-17 23:32:18 [DEBUG   ] Got command RPT from MCS: ref #1200963
2019-01-17 23:32:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200963  77 58500 84738017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:32:18 [DEBUG   ] Got command RPT from MCS: ref #1200964
2019-01-17 23:32:18 [DEBUG   ] summary = ERROR
2019-01-17 23:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200964  13 58500 84738209 A  ERRORERROR'
2019-01-17 23:32:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 23:32:18 [DEBUG   ] Got command RPT from MCS: ref #1200965
2019-01-17 23:32:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200965  77 58500 84738413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:32:18 [DEBUG   ] Got command RPT from MCS: ref #1200966
2019-01-17 23:32:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200966  12 58500 84738617 A  ERRORB•™š'
2019-01-17 23:32:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:32:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:32:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:32:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:32:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:32:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:32:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:32:45 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-17 23:32:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 23:33:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 23:33:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 23:33:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:33:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:33:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:33:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:33:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:33:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:33:45 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-17 23:33:58 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2019-01-17 23:34:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 23:34:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 23:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:34:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:34:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:34:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:34:45 [WARNING ] (13, 1, 'bot')
2019-01-17 23:34:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:34:45 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-17 23:34:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 23:35:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 23:35:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-17 23:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:35:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:35:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:35:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:35:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:35:46 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-01-17 23:35:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 23:36:05 [DEBUG   ] Got command RPT from MCS: ref #1200971
2019-01-17 23:36:05 [DEBUG   ] summary = ERROR
2019-01-17 23:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200971  13 58500 84965789 A  ERRORERROR'
2019-01-17 23:36:05 [DEBUG   ] Got command RPT from MCS: ref #1200972
2019-01-17 23:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200972  77 58500 84965790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:36:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 23:36:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-17 23:36:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:36:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:36:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:36:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:36:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:36:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:36:46 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-17 23:36:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:37:17 [DEBUG   ] Got command RPT from MCS: ref #1200994
2019-01-17 23:37:17 [DEBUG   ] summary = ERROR
2019-01-17 23:37:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200994  13 58500 85037897 A  ERRORERROR'
2019-01-17 23:37:18 [DEBUG   ] Got command RPT from MCS: ref #1200995
2019-01-17 23:37:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200995  77 58500 85038089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:37:18 [DEBUG   ] Got command RPT from MCS: ref #1200996
2019-01-17 23:37:18 [DEBUG   ] summary = ERROR
2019-01-17 23:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200996  13 58500 85038293 A  ERRORERROR'
2019-01-17 23:37:18 [DEBUG   ] Got command RPT from MCS: ref #1200998
2019-01-17 23:37:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1200998  77 58500 85038489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:37:18 [DEBUG   ] Got command RPT from MCS: ref #1201000
2019-01-17 23:37:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201000  12 58500 85038693 A  ERRORB•™š'
2019-01-17 23:37:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:37:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-17 23:37:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:37:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:37:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:37:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:37:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:37:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:37:46 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-17 23:37:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 23:38:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 23:38:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:38:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:38:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:38:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:38:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:38:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:38:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:38:46 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-17 23:38:59 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-17 23:39:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 23:39:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-17 23:39:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:39:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:39:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:39:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:39:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:39:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:39:46 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-17 23:40:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 23:40:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-17 23:40:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-17 23:40:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:40:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:40:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:40:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:40:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:40:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:40:46 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-17 23:41:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:41:05 [DEBUG   ] Got command RPT from MCS: ref #1201008
2019-01-17 23:41:05 [DEBUG   ] summary = ERROR
2019-01-17 23:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201008  13 58500 85265789 A  ERRORERROR'
2019-01-17 23:41:05 [DEBUG   ] Got command RPT from MCS: ref #1201009
2019-01-17 23:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201009  77 58500 85265790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:41:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:41:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 23:41:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:41:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:41:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:41:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:41:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:41:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:41:46 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-17 23:42:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:42:17 [DEBUG   ] Got command RPT from MCS: ref #1201025
2019-01-17 23:42:17 [DEBUG   ] summary = ERROR
2019-01-17 23:42:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201025  13 58500 85337977 A  ERRORERROR'
2019-01-17 23:42:18 [DEBUG   ] Got command RPT from MCS: ref #1201026
2019-01-17 23:42:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201026  77 58500 85338169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:42:18 [DEBUG   ] Got command RPT from MCS: ref #1201027
2019-01-17 23:42:18 [DEBUG   ] summary = ERROR
2019-01-17 23:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201027  13 58500 85338373 A  ERRORERROR'
2019-01-17 23:42:18 [DEBUG   ] Got command RPT from MCS: ref #1201028
2019-01-17 23:42:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201028  77 58500 85338577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:42:18 [DEBUG   ] Got command RPT from MCS: ref #1201029
2019-01-17 23:42:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201029  12 58500 85338781 A  ERRORB”™š'
2019-01-17 23:42:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:42:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:42:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:42:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:42:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:42:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:42:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:42:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:42:46 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-17 23:43:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 23:43:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 23:43:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-17 23:43:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:43:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:43:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:43:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:43:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:43:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:43:46 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-17 23:44:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-17 23:44:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-17 23:44:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-17 23:44:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:44:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:44:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:44:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:44:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:44:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:44:46 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-17 23:45:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-17 23:45:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 23:45:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:45:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:45:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 23:45:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:45:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:45:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:45:46 [WARNING ] (13, 1, 'bot')
2019-01-17 23:45:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:45:46 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-17 23:46:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-01-17 23:46:05 [DEBUG   ] Got command RPT from MCS: ref #1201038
2019-01-17 23:46:05 [DEBUG   ] summary = ERROR
2019-01-17 23:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201038  13 58500 85565793 A  ERRORERROR'
2019-01-17 23:46:05 [DEBUG   ] Got command RPT from MCS: ref #1201039
2019-01-17 23:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201039  77 58500 85565794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:46:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-17 23:46:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 23:46:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:46:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:46:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:46:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:46:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:46:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:46:47 [DEBUG   ] Finished updating board flags in 2.080 seconds
2019-01-17 23:47:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-17 23:47:18 [DEBUG   ] Got command RPT from MCS: ref #1201057
2019-01-17 23:47:18 [DEBUG   ] summary = ERROR
2019-01-17 23:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201057  13 58500 85638057 A  ERRORERROR'
2019-01-17 23:47:18 [DEBUG   ] Got command RPT from MCS: ref #1201058
2019-01-17 23:47:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201058  77 58500 85638249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:47:18 [DEBUG   ] Got command RPT from MCS: ref #1201059
2019-01-17 23:47:18 [DEBUG   ] summary = ERROR
2019-01-17 23:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201059  13 58500 85638453 A  ERRORERROR'
2019-01-17 23:47:18 [DEBUG   ] Got command RPT from MCS: ref #1201061
2019-01-17 23:47:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201061  77 58500 85638657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:47:18 [DEBUG   ] Got command RPT from MCS: ref #1201062
2019-01-17 23:47:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201062  12 58500 85638861 A  ERRORB”™š'
2019-01-17 23:47:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 23:47:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-17 23:47:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:47:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:47:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:47:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:47:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:47:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:47:47 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-17 23:48:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-17 23:48:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-17 23:48:42 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2019-01-17 23:48:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:48:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:48:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:48:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:48:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:48:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:48:47 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-17 23:49:02 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-17 23:49:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-17 23:49:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 23:49:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:49:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:49:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:49:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:49:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:49:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:49:47 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-17 23:50:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-17 23:50:22 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2019-01-17 23:50:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 23:50:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:50:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:50:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:50:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:50:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:50:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:50:47 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-17 23:51:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:51:05 [DEBUG   ] Got command RPT from MCS: ref #1201071
2019-01-17 23:51:05 [DEBUG   ] summary = ERROR
2019-01-17 23:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201071  13 58500 85865793 A  ERRORERROR'
2019-01-17 23:51:05 [DEBUG   ] Got command RPT from MCS: ref #1201072
2019-01-17 23:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201072  77 58500 85865794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:51:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:51:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-17 23:51:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:51:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:51:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:51:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:51:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:51:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:51:47 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-17 23:52:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 23:52:18 [DEBUG   ] Got command RPT from MCS: ref #1201092
2019-01-17 23:52:18 [DEBUG   ] summary = ERROR
2019-01-17 23:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201092  13 58500 85938129 A  ERRORERROR'
2019-01-17 23:52:18 [DEBUG   ] Got command RPT from MCS: ref #1201093
2019-01-17 23:52:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201093  77 58500 85938333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:52:18 [DEBUG   ] Got command RPT from MCS: ref #1201094
2019-01-17 23:52:18 [DEBUG   ] summary = ERROR
2019-01-17 23:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201094  13 58500 85938537 A  ERRORERROR'
2019-01-17 23:52:18 [DEBUG   ] Got command RPT from MCS: ref #1201095
2019-01-17 23:52:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201095  77 58500 85938729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:52:18 [DEBUG   ] Got command RPT from MCS: ref #1201096
2019-01-17 23:52:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201096  12 58500 85938933 A  ERRORB”™š'
2019-01-17 23:52:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:52:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-17 23:52:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:52:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:52:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:52:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:52:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:52:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:52:47 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-17 23:53:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-17 23:53:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 23:53:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 23:53:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:53:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:53:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:53:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:53:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:53:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:53:47 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-17 23:54:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-17 23:54:22 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-17 23:54:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-17 23:54:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:54:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:54:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:54:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:54:47 [WARNING ] (13, 1, 'bot')
2019-01-17 23:54:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:54:47 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-01-17 23:55:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-17 23:55:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-17 23:55:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 23:55:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:55:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-17 23:55:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:55:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:55:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:55:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:55:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:55:48 [DEBUG   ] Finished updating board flags in 2.052 seconds
2019-01-17 23:56:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-17 23:56:05 [DEBUG   ] Got command RPT from MCS: ref #1201101
2019-01-17 23:56:05 [DEBUG   ] summary = ERROR
2019-01-17 23:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201101  13 58500 86165797 A  ERRORERROR'
2019-01-17 23:56:05 [DEBUG   ] Got command RPT from MCS: ref #1201102
2019-01-17 23:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201102  77 58500 86165798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:56:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-17 23:56:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-17 23:56:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:56:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:56:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:56:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:56:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:56:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:56:48 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-17 23:57:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-17 23:57:18 [DEBUG   ] Got command RPT from MCS: ref #1201120
2019-01-17 23:57:18 [DEBUG   ] summary = ERROR
2019-01-17 23:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201120  13 58500 86238217 A  ERRORERROR'
2019-01-17 23:57:18 [DEBUG   ] Got command RPT from MCS: ref #1201121
2019-01-17 23:57:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201121  77 58500 86238409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:57:18 [DEBUG   ] Got command RPT from MCS: ref #1201122
2019-01-17 23:57:18 [DEBUG   ] summary = ERROR
2019-01-17 23:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201122  13 58500 86238613 A  ERRORERROR'
2019-01-17 23:57:18 [DEBUG   ] Got command RPT from MCS: ref #1201124
2019-01-17 23:57:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-17 23:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201124  77 58500 86238817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-17 23:57:19 [DEBUG   ] Got command RPT from MCS: ref #1201126
2019-01-17 23:57:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-17 23:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201126  12 58500 86239009 A  ERRORB•™š'
2019-01-17 23:57:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-17 23:57:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-17 23:57:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-17 23:57:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:57:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:57:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:57:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:57:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:57:48 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-17 23:58:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-17 23:58:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-17 23:58:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-17 23:58:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:58:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:58:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:58:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:58:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:58:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:58:48 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-17 23:59:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-17 23:59:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 23:59:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-17 23:59:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-17 23:59:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:59:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:59:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:59:48 [WARNING ] (13, 1, 'bot')
2019-01-17 23:59:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-17 23:59:48 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-18 00:00:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-18 00:00:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 00:00:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 00:00:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:00:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:00:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:00:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:00:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:00:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:00:48 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-18 00:01:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-18 00:01:05 [DEBUG   ] Got command RPT from MCS: ref #1201138
2019-01-18 00:01:05 [DEBUG   ] summary = ERROR
2019-01-18 00:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201138  13 58501    65793 A  ERRORERROR'
2019-01-18 00:01:05 [DEBUG   ] Got command RPT from MCS: ref #1201139
2019-01-18 00:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201139  77 58501    65794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:01:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-18 00:01:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 00:01:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:01:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:01:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:01:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:01:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:01:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:01:48 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-18 00:02:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 00:02:18 [DEBUG   ] Got command RPT from MCS: ref #1201155
2019-01-18 00:02:18 [DEBUG   ] summary = ERROR
2019-01-18 00:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201155  13 58501   138297 A  ERRORERROR'
2019-01-18 00:02:18 [DEBUG   ] Got command RPT from MCS: ref #1201156
2019-01-18 00:02:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201156  77 58501   138489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:02:18 [DEBUG   ] Got command RPT from MCS: ref #1201157
2019-01-18 00:02:18 [DEBUG   ] summary = ERROR
2019-01-18 00:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201157  13 58501   138693 A  ERRORERROR'
2019-01-18 00:02:18 [DEBUG   ] Got command RPT from MCS: ref #1201158
2019-01-18 00:02:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201158  77 58501   138897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:02:19 [DEBUG   ] Got command RPT from MCS: ref #1201159
2019-01-18 00:02:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201159  12 58501   139101 A  ERRORB˜™š'
2019-01-18 00:02:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 00:02:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 00:02:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:02:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:02:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:02:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:02:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:02:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:02:48 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-18 00:03:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 00:03:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 00:03:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-18 00:03:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:03:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:03:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:03:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:03:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:03:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:03:48 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-18 00:04:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 00:04:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 00:04:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 00:04:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:04:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:04:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:04:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:04:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:04:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:04:48 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-18 00:05:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 00:05:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 00:05:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 00:05:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:05:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:05:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:05:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:05:48 [WARNING ] (13, 1, 'bot')
2019-01-18 00:05:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:05:48 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-18 00:06:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:06:05 [DEBUG   ] Got command RPT from MCS: ref #1201164
2019-01-18 00:06:05 [DEBUG   ] summary = ERROR
2019-01-18 00:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201164  13 58501   365797 A  ERRORERROR'
2019-01-18 00:06:05 [DEBUG   ] Got command RPT from MCS: ref #1201165
2019-01-18 00:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201165  77 58501   365798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:06:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-18 00:06:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 00:06:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:06:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:06:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:06:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:06:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:06:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:06:49 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-01-18 00:07:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 00:07:18 [DEBUG   ] Got command RPT from MCS: ref #1201187
2019-01-18 00:07:18 [DEBUG   ] summary = ERROR
2019-01-18 00:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201187  13 58501   438369 A  ERRORERROR'
2019-01-18 00:07:18 [DEBUG   ] Got command RPT from MCS: ref #1201188
2019-01-18 00:07:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201188  77 58501   438573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:07:18 [DEBUG   ] Got command RPT from MCS: ref #1201189
2019-01-18 00:07:18 [DEBUG   ] summary = ERROR
2019-01-18 00:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201189  13 58501   438777 A  ERRORERROR'
2019-01-18 00:07:18 [DEBUG   ] Got command RPT from MCS: ref #1201191
2019-01-18 00:07:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201191  77 58501   438981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:07:19 [DEBUG   ] Got command RPT from MCS: ref #1201192
2019-01-18 00:07:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201192  12 58501   439173 A  ERRORB—™š'
2019-01-18 00:07:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 00:07:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 00:07:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:07:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:07:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:07:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:07:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:07:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:07:49 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-18 00:08:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 00:08:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 00:08:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 00:08:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:08:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:08:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:08:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:08:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:08:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:08:49 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-18 00:09:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 00:09:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 00:09:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 00:09:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:09:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:09:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:09:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:09:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:09:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:09:49 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-18 00:10:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-18 00:10:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 00:10:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 00:10:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:10:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:10:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:10:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:10:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:10:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:10:49 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-18 00:11:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 00:11:05 [DEBUG   ] Got command RPT from MCS: ref #1201201
2019-01-18 00:11:05 [DEBUG   ] summary = ERROR
2019-01-18 00:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201201  13 58501   665793 A  ERRORERROR'
2019-01-18 00:11:05 [DEBUG   ] Got command RPT from MCS: ref #1201202
2019-01-18 00:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201202  77 58501   665794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:11:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 00:11:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 00:11:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:11:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 00:11:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:11:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:11:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:11:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:11:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:11:49 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-18 00:12:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:12:18 [DEBUG   ] Got command RPT from MCS: ref #1201218
2019-01-18 00:12:18 [DEBUG   ] summary = ERROR
2019-01-18 00:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201218  13 58501   738457 A  ERRORERROR'
2019-01-18 00:12:18 [DEBUG   ] Got command RPT from MCS: ref #1201219
2019-01-18 00:12:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201219  77 58501   738649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:12:18 [DEBUG   ] Got command RPT from MCS: ref #1201220
2019-01-18 00:12:18 [DEBUG   ] summary = ERROR
2019-01-18 00:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201220  13 58501   738853 A  ERRORERROR'
2019-01-18 00:12:19 [DEBUG   ] Got command RPT from MCS: ref #1201221
2019-01-18 00:12:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201221  77 58501   739057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:12:19 [DEBUG   ] Got command RPT from MCS: ref #1201222
2019-01-18 00:12:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201222  12 58501   739261 A  ERRORB—™š'
2019-01-18 00:12:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 00:12:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-18 00:12:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:12:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 00:12:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-18 00:12:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:12:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:12:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:12:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:12:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:12:49 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-18 00:13:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 00:13:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 00:13:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 00:13:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:13:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-18 00:13:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:13:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:13:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:13:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:13:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:13:49 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-18 00:14:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 00:14:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 00:14:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 00:14:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:14:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:14:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:14:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:14:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:14:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:14:49 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-18 00:15:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 00:15:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 00:15:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 00:15:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:15:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:15:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:15:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:15:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:15:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:15:49 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-18 00:16:05 [DEBUG   ] Got command RPT from MCS: ref #1201231
2019-01-18 00:16:05 [DEBUG   ] summary = ERROR
2019-01-18 00:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201231  13 58501   965801 A  ERRORERROR'
2019-01-18 00:16:05 [DEBUG   ] Got command RPT from MCS: ref #1201232
2019-01-18 00:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201232  77 58501   965802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:16:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 00:16:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 00:16:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 00:16:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:16:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:16:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:16:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:16:49 [WARNING ] (13, 1, 'bot')
2019-01-18 00:16:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:16:49 [DEBUG   ] Finished updating board flags in 1.469 seconds
2019-01-18 00:17:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 00:17:18 [DEBUG   ] Got command RPT from MCS: ref #1201250
2019-01-18 00:17:18 [DEBUG   ] summary = ERROR
2019-01-18 00:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201250  13 58501  1038529 A  ERRORERROR'
2019-01-18 00:17:18 [DEBUG   ] Got command RPT from MCS: ref #1201251
2019-01-18 00:17:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201251  77 58501  1038733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:17:18 [DEBUG   ] Got command RPT from MCS: ref #1201252
2019-01-18 00:17:18 [DEBUG   ] summary = ERROR
2019-01-18 00:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201252  13 58501  1038937 A  ERRORERROR'
2019-01-18 00:17:19 [DEBUG   ] Got command RPT from MCS: ref #1201254
2019-01-18 00:17:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201254  77 58501  1039141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:17:19 [DEBUG   ] Got command RPT from MCS: ref #1201255
2019-01-18 00:17:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201255  12 58501  1039333 A  ERRORB–™š'
2019-01-18 00:17:27 [DEBUG   ] Finished updating ant stats in 1.803 seconds
2019-01-18 00:17:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 00:17:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:17:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:17:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:17:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:17:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:17:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:17:50 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-18 00:18:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 00:18:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 00:18:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 00:18:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:18:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-18 00:18:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:18:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:18:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:18:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:18:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:18:50 [DEBUG   ] Finished updating board flags in 2.141 seconds
2019-01-18 00:19:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 00:19:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 00:19:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 00:19:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:19:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:19:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:19:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:19:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:19:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:19:50 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-18 00:20:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 00:20:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 00:20:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 00:20:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:20:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:20:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:20:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:20:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:20:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:20:50 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-18 00:21:05 [DEBUG   ] Got command RPT from MCS: ref #1201264
2019-01-18 00:21:05 [DEBUG   ] summary = ERROR
2019-01-18 00:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201264  13 58501  1265797 A  ERRORERROR'
2019-01-18 00:21:05 [DEBUG   ] Got command RPT from MCS: ref #1201265
2019-01-18 00:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201265  77 58501  1265798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:21:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 00:21:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 00:21:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 00:21:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:21:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:21:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:21:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:21:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:21:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:21:50 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-18 00:22:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 00:22:18 [DEBUG   ] Got command RPT from MCS: ref #1201285
2019-01-18 00:22:18 [DEBUG   ] summary = ERROR
2019-01-18 00:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201285  13 58501  1338613 A  ERRORERROR'
2019-01-18 00:22:18 [DEBUG   ] Got command RPT from MCS: ref #1201286
2019-01-18 00:22:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201286  77 58501  1338817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:22:19 [DEBUG   ] Got command RPT from MCS: ref #1201287
2019-01-18 00:22:19 [DEBUG   ] summary = ERROR
2019-01-18 00:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201287  13 58501  1339009 A  ERRORERROR'
2019-01-18 00:22:19 [DEBUG   ] Got command RPT from MCS: ref #1201288
2019-01-18 00:22:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201288  77 58501  1339213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:22:19 [DEBUG   ] Got command RPT from MCS: ref #1201289
2019-01-18 00:22:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201289  12 58501  1339418 A  ERRORB•™š'
2019-01-18 00:22:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 00:22:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 00:22:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:22:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:22:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:22:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:22:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:22:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:22:50 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-18 00:23:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 00:23:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 00:23:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-18 00:23:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:23:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:23:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:23:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:23:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:23:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:23:50 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-18 00:24:07 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-18 00:24:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:24:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:24:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:24:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:24:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:24:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:24:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:24:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:24:50 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-18 00:25:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-18 00:25:27 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-18 00:25:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 00:25:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:25:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:25:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:25:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:25:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:25:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:25:50 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-18 00:26:05 [DEBUG   ] Got command RPT from MCS: ref #1201294
2019-01-18 00:26:05 [DEBUG   ] summary = ERROR
2019-01-18 00:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201294  13 58501  1565793 A  ERRORERROR'
2019-01-18 00:26:05 [DEBUG   ] Got command RPT from MCS: ref #1201295
2019-01-18 00:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201295  77 58501  1565794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:26:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 00:26:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 00:26:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 00:26:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:26:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-18 00:26:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:26:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:26:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:26:50 [WARNING ] (13, 1, 'bot')
2019-01-18 00:26:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:26:50 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-01-18 00:27:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 00:27:18 [DEBUG   ] Got command RPT from MCS: ref #1201313
2019-01-18 00:27:18 [DEBUG   ] summary = ERROR
2019-01-18 00:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201313  13 58501  1638701 A  ERRORERROR'
2019-01-18 00:27:18 [DEBUG   ] Got command RPT from MCS: ref #1201314
2019-01-18 00:27:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201314  77 58501  1638893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:27:19 [DEBUG   ] Got command RPT from MCS: ref #1201315
2019-01-18 00:27:19 [DEBUG   ] summary = ERROR
2019-01-18 00:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201315  13 58501  1639097 A  ERRORERROR'
2019-01-18 00:27:19 [DEBUG   ] Got command RPT from MCS: ref #1201317
2019-01-18 00:27:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201317  77 58501  1639301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:27:19 [DEBUG   ] Got command RPT from MCS: ref #1201319
2019-01-18 00:27:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201319  12 58501  1639505 A  ERRORB•™š'
2019-01-18 00:27:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 00:27:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 00:27:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:27:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:27:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:27:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:27:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:27:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:27:51 [DEBUG   ] Finished updating board flags in 2.040 seconds
2019-01-18 00:28:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 00:28:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 00:28:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 00:28:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:28:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:28:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:28:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:28:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:28:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:28:51 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-18 00:29:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 00:29:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:29:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:29:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:29:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:29:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:29:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:29:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:29:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:29:51 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-01-18 00:30:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 00:30:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 00:30:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 00:30:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:30:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:30:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:30:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:30:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:30:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:30:51 [DEBUG   ] Finished updating board flags in 1.966 seconds
2019-01-18 00:31:05 [DEBUG   ] Got command RPT from MCS: ref #1201331
2019-01-18 00:31:05 [DEBUG   ] summary = ERROR
2019-01-18 00:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201331  13 58501  1865797 A  ERRORERROR'
2019-01-18 00:31:05 [DEBUG   ] Got command RPT from MCS: ref #1201332
2019-01-18 00:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201332  77 58501  1865798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:31:09 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-18 00:31:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 00:31:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 00:31:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:31:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:31:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:31:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:31:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:31:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:31:51 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-18 00:32:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 00:32:18 [DEBUG   ] Got command RPT from MCS: ref #1201348
2019-01-18 00:32:18 [DEBUG   ] summary = ERROR
2019-01-18 00:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201348  13 58501  1938781 A  ERRORERROR'
2019-01-18 00:32:18 [DEBUG   ] Got command RPT from MCS: ref #1201349
2019-01-18 00:32:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201349  77 58501  1938985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:32:19 [DEBUG   ] Got command RPT from MCS: ref #1201350
2019-01-18 00:32:19 [DEBUG   ] summary = ERROR
2019-01-18 00:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201350  13 58501  1939189 A  ERRORERROR'
2019-01-18 00:32:19 [DEBUG   ] Got command RPT from MCS: ref #1201351
2019-01-18 00:32:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201351  77 58501  1939381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:32:19 [DEBUG   ] Got command RPT from MCS: ref #1201352
2019-01-18 00:32:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201352  12 58501  1939585 A  ERRORB•™š'
2019-01-18 00:32:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 00:32:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 00:32:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:32:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-18 00:32:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:32:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:32:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:32:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:32:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:32:51 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-18 00:33:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:33:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:33:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 00:33:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:33:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:33:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:33:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:33:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:33:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:33:51 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-18 00:34:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 00:34:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 00:34:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 00:34:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:34:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:34:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:34:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:34:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:34:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:34:51 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-18 00:35:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 00:35:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 00:35:50 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2019-01-18 00:35:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:35:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:35:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:35:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:35:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:35:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:35:51 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-18 00:36:05 [DEBUG   ] Got command RPT from MCS: ref #1201357
2019-01-18 00:36:05 [DEBUG   ] summary = ERROR
2019-01-18 00:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201357  13 58501  2165797 A  ERRORERROR'
2019-01-18 00:36:05 [DEBUG   ] Got command RPT from MCS: ref #1201358
2019-01-18 00:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201358  77 58501  2165798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:36:10 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2019-01-18 00:36:30 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-18 00:36:50 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2019-01-18 00:36:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:36:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:36:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:36:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:36:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:36:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:36:51 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-18 00:37:10 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2019-01-18 00:37:18 [DEBUG   ] Got command RPT from MCS: ref #1201380
2019-01-18 00:37:18 [DEBUG   ] summary = ERROR
2019-01-18 00:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201380  13 58501  2238869 A  ERRORERROR'
2019-01-18 00:37:19 [DEBUG   ] Got command RPT from MCS: ref #1201381
2019-01-18 00:37:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201381  77 58501  2239073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:37:19 [DEBUG   ] Got command RPT from MCS: ref #1201382
2019-01-18 00:37:19 [DEBUG   ] summary = ERROR
2019-01-18 00:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201382  13 58501  2239265 A  ERRORERROR'
2019-01-18 00:37:19 [DEBUG   ] Got command RPT from MCS: ref #1201384
2019-01-18 00:37:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201384  77 58501  2239469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:37:19 [DEBUG   ] Got command RPT from MCS: ref #1201385
2019-01-18 00:37:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201385  12 58501  2239700 A  ERRORB”™š'
2019-01-18 00:37:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 00:37:50 [DEBUG   ] Finished updating ant stats in 0.640 seconds
2019-01-18 00:37:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:37:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:37:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:37:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:37:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:37:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:37:51 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-18 00:38:10 [DEBUG   ] Finished updating ant stats in 0.562 seconds
2019-01-18 00:38:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-18 00:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:38:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-18 00:38:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:38:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:38:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:38:51 [WARNING ] (13, 1, 'bot')
2019-01-18 00:38:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:38:51 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-01-18 00:39:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 00:39:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 00:39:51 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2019-01-18 00:39:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:39:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:39:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:39:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:39:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:39:52 [DEBUG   ] Finished updating board flags in 2.075 seconds
2019-01-18 00:40:11 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2019-01-18 00:40:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 00:40:51 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2019-01-18 00:40:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:40:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:40:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:40:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:40:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:40:52 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-18 00:41:05 [DEBUG   ] Got command RPT from MCS: ref #1201394
2019-01-18 00:41:05 [DEBUG   ] summary = ERROR
2019-01-18 00:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201394  13 58501  2465801 A  ERRORERROR'
2019-01-18 00:41:05 [DEBUG   ] Got command RPT from MCS: ref #1201395
2019-01-18 00:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201395  77 58501  2465802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:41:11 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-01-18 00:41:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 00:41:51 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2019-01-18 00:41:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:41:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:41:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:41:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:41:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:41:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:41:52 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-01-18 00:42:11 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-01-18 00:42:18 [DEBUG   ] Got command RPT from MCS: ref #1201411
2019-01-18 00:42:18 [DEBUG   ] summary = ERROR
2019-01-18 00:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201411  13 58501  2538949 A  ERRORERROR'
2019-01-18 00:42:19 [DEBUG   ] Got command RPT from MCS: ref #1201412
2019-01-18 00:42:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201412  77 58501  2539153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:42:19 [DEBUG   ] Got command RPT from MCS: ref #1201413
2019-01-18 00:42:19 [DEBUG   ] summary = ERROR
2019-01-18 00:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201413  13 58501  2539363 A  ERRORERROR'
2019-01-18 00:42:19 [DEBUG   ] Got command RPT from MCS: ref #1201414
2019-01-18 00:42:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201414  77 58501  2539553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:42:19 [DEBUG   ] Got command RPT from MCS: ref #1201415
2019-01-18 00:42:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201415  12 58501  2539757 A  ERRORB”™š'
2019-01-18 00:42:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 00:42:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:42:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 00:42:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:42:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:42:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:42:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:42:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:42:52 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-18 00:43:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-18 00:43:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 00:43:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:43:52 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-01-18 00:43:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:43:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:43:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:43:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:43:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:43:52 [DEBUG   ] Finished updating board flags in 1.848 seconds
2019-01-18 00:44:12 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2019-01-18 00:44:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 00:44:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:44:52 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2019-01-18 00:44:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:44:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:44:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:44:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:44:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:44:52 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-18 00:45:12 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-01-18 00:45:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 00:45:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 00:45:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:45:52 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-01-18 00:45:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:45:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:45:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:45:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:45:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:45:52 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-01-18 00:46:05 [DEBUG   ] Got command RPT from MCS: ref #1201424
2019-01-18 00:46:05 [DEBUG   ] summary = ERROR
2019-01-18 00:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201424  13 58501  2765801 A  ERRORERROR'
2019-01-18 00:46:05 [DEBUG   ] Got command RPT from MCS: ref #1201425
2019-01-18 00:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201425  77 58501  2765802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:46:12 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-18 00:46:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 00:46:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 00:46:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:46:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:46:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:46:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:46:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:46:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:46:52 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-18 00:46:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 00:47:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 00:47:19 [DEBUG   ] Got command RPT from MCS: ref #1201443
2019-01-18 00:47:19 [DEBUG   ] summary = ERROR
2019-01-18 00:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201443  13 58501  2839045 A  ERRORERROR'
2019-01-18 00:47:19 [DEBUG   ] Got command RPT from MCS: ref #1201444
2019-01-18 00:47:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201444  77 58501  2839237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:47:19 [DEBUG   ] Got command RPT from MCS: ref #1201445
2019-01-18 00:47:19 [DEBUG   ] summary = ERROR
2019-01-18 00:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201445  13 58501  2839441 A  ERRORERROR'
2019-01-18 00:47:19 [DEBUG   ] Got command RPT from MCS: ref #1201447
2019-01-18 00:47:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201447  77 58501  2839645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:47:19 [DEBUG   ] Got command RPT from MCS: ref #1201448
2019-01-18 00:47:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201448  12 58501  2839837 A  ERRORB–™š'
2019-01-18 00:47:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 00:47:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 00:47:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:47:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 00:47:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:47:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:47:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:47:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:47:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:47:52 [DEBUG   ] Finished updating board flags in 1.569 seconds
2019-01-18 00:47:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 00:48:00 [DEBUG   ] Got command TBN from MCS: ref #1201453
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-18 00:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1201453   8 58501  2880913 A  ERROR'
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547772482']
2019-01-18 00:48:00 [DEBUG   ] spawn_process: at 2019-01-18 00:48:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547772482']
2019-01-18 00:48:00 [INFO    ] Finished spawning TBN in 0.054 s
2019-01-18 00:48:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 00:48:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 00:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 00:48:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:48:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:48:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:48:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:48:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:48:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:48:52 [DEBUG   ] Finished updating board flags in 1.511 seconds
2019-01-18 00:48:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 00:49:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 00:49:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 00:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 00:49:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:49:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:49:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:49:52 [WARNING ] (13, 1, 'bot')
2019-01-18 00:49:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:49:52 [DEBUG   ] Finished updating board flags in 1.527 seconds
2019-01-18 00:49:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 00:50:13 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-18 00:50:33 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-18 00:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:50:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 00:50:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:50:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:50:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:50:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:50:53 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-01-18 00:50:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 00:51:05 [DEBUG   ] Got command RPT from MCS: ref #1201458
2019-01-18 00:51:05 [DEBUG   ] summary = ERROR
2019-01-18 00:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201458  13 58501  3065801 A  ERRORERROR'
2019-01-18 00:51:05 [DEBUG   ] Got command RPT from MCS: ref #1201459
2019-01-18 00:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201459  77 58501  3065802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:51:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 00:51:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 00:51:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:51:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 00:51:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:51:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:51:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:51:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:51:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:51:53 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-18 00:51:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 00:52:11 [DEBUG   ] Got command TBW from MCS: ref #1201480
2019-01-18 00:52:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-18 00:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1201480   8 58501  3131985 A  ERROR'
2019-01-18 00:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-18 00:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-18 00:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-18 00:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-18 00:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-18 00:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-18 00:52:15 [DEBUG   ] spawn_process: at 2019-01-18 00:52:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-18 00:52:15 [INFO    ] Finished spawning TBW
2019-01-18 00:52:19 [DEBUG   ] Got command RPT from MCS: ref #1201482
2019-01-18 00:52:19 [DEBUG   ] summary = ERROR
2019-01-18 00:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201482  13 58501  3139125 A  ERRORERROR'
2019-01-18 00:52:19 [DEBUG   ] Got command RPT from MCS: ref #1201483
2019-01-18 00:52:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201483  77 58501  3139329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:52:19 [DEBUG   ] Got command RPT from MCS: ref #1201484
2019-01-18 00:52:19 [DEBUG   ] summary = ERROR
2019-01-18 00:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201484  13 58501  3139533 A  ERRORERROR'
2019-01-18 00:52:19 [DEBUG   ] Got command RPT from MCS: ref #1201485
2019-01-18 00:52:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201485  77 58501  3139725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:52:19 [DEBUG   ] Got command RPT from MCS: ref #1201486
2019-01-18 00:52:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201486  12 58501  3139929 A  ERRORB—™š'
2019-01-18 00:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 00:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:52:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:52:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:52:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:52:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:52:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:52:53 [DEBUG   ] Finished updating board flags in 1.865 seconds
2019-01-18 00:53:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:53:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:53:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:53:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:53:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:53:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:53:53 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-18 00:54:03 [INFO    ] __waitForTBW - TBW finished in 108.406 s
2019-01-18 00:54:04 [DEBUG   ] Finished updating ant stats in 0.351 seconds
2019-01-18 00:54:04 [INFO    ] Started antennas statistics background thread
2019-01-18 00:54:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547772846']
2019-01-18 00:54:04 [DEBUG   ] spawn_process: at 2019-01-18 00:54:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547772846']
2019-01-18 00:54:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-18 00:54:25 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2019-01-18 00:54:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 00:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:54:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:54:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:54:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:54:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:54:53 [DEBUG   ] Finished updating board flags in 1.970 seconds
2019-01-18 00:55:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 00:55:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 00:55:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 00:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 00:55:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:55:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:55:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:55:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:55:53 [DEBUG   ] Finished updating board flags in 1.729 seconds
2019-01-18 00:56:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 00:56:05 [DEBUG   ] Got command RPT from MCS: ref #1201497
2019-01-18 00:56:05 [DEBUG   ] summary = ERROR
2019-01-18 00:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201497  13 58501  3365805 A  ERRORERROR'
2019-01-18 00:56:05 [DEBUG   ] Got command RPT from MCS: ref #1201498
2019-01-18 00:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201498  77 58501  3365806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:56:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 00:56:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:56:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 00:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-18 00:56:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:56:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:56:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:56:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:56:53 [DEBUG   ] Finished updating board flags in 1.547 seconds
2019-01-18 00:57:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 00:57:19 [DEBUG   ] Got command RPT from MCS: ref #1201516
2019-01-18 00:57:19 [DEBUG   ] summary = ERROR
2019-01-18 00:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201516  13 58501  3439209 A  ERRORERROR'
2019-01-18 00:57:19 [DEBUG   ] Got command RPT from MCS: ref #1201517
2019-01-18 00:57:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201517  77 58501  3439413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:57:19 [DEBUG   ] Got command RPT from MCS: ref #1201518
2019-01-18 00:57:19 [DEBUG   ] summary = ERROR
2019-01-18 00:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201518  13 58501  3439617 A  ERRORERROR'
2019-01-18 00:57:19 [DEBUG   ] Got command RPT from MCS: ref #1201520
2019-01-18 00:57:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 00:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201520  77 58501  3439809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 00:57:20 [DEBUG   ] Got command RPT from MCS: ref #1201521
2019-01-18 00:57:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 00:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201521  12 58501  3440013 A  ERRORB–™š'
2019-01-18 00:57:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 00:57:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 00:57:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:57:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:57:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:57:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:57:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:57:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:57:53 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-18 00:58:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 00:58:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-18 00:58:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 00:58:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:58:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:58:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:58:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:58:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:58:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:58:53 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-18 00:59:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 00:59:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 00:59:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 00:59:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 00:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-18 00:59:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:59:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:59:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:59:53 [WARNING ] (13, 1, 'bot')
2019-01-18 00:59:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 00:59:53 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-18 01:00:06 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-18 01:00:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 01:00:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-18 01:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:00:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:00:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:00:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:00:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:00:54 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-18 01:01:05 [DEBUG   ] Got command RPT from MCS: ref #1201534
2019-01-18 01:01:05 [DEBUG   ] summary = ERROR
2019-01-18 01:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201534  13 58501  3665805 A  ERRORERROR'
2019-01-18 01:01:05 [DEBUG   ] Got command RPT from MCS: ref #1201535
2019-01-18 01:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201535  77 58501  3665806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:01:07 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-18 01:01:27 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-18 01:01:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 01:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:01:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:01:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:01:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:01:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:01:54 [DEBUG   ] Finished updating board flags in 2.177 seconds
2019-01-18 01:02:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 01:02:19 [DEBUG   ] Got command RPT from MCS: ref #1201551
2019-01-18 01:02:19 [DEBUG   ] summary = ERROR
2019-01-18 01:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201551  13 58501  3739297 A  ERRORERROR'
2019-01-18 01:02:19 [DEBUG   ] Got command RPT from MCS: ref #1201552
2019-01-18 01:02:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201552  77 58501  3739501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:02:19 [DEBUG   ] Got command RPT from MCS: ref #1201553
2019-01-18 01:02:19 [DEBUG   ] summary = ERROR
2019-01-18 01:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201553  13 58501  3739708 A  ERRORERROR'
2019-01-18 01:02:19 [DEBUG   ] Got command RPT from MCS: ref #1201554
2019-01-18 01:02:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201554  77 58501  3739897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:02:20 [DEBUG   ] Got command RPT from MCS: ref #1201555
2019-01-18 01:02:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201555  12 58501  3740101 A  ERRORB•™š'
2019-01-18 01:02:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:02:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:02:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:02:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:02:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:02:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:02:54 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-18 01:03:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-18 01:03:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 01:03:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:03:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:03:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:03:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:03:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:03:54 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-18 01:04:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:04:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:04:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:04:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:04:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:04:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:04:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:04:54 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-01-18 01:05:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:05:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:05:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:05:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:05:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:05:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:05:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:05:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:05:54 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-01-18 01:06:05 [DEBUG   ] Got command RPT from MCS: ref #1201560
2019-01-18 01:06:05 [DEBUG   ] summary = ERROR
2019-01-18 01:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201560  13 58501  3965801 A  ERRORERROR'
2019-01-18 01:06:05 [DEBUG   ] Got command RPT from MCS: ref #1201561
2019-01-18 01:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201561  77 58501  3965802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:06:07 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2019-01-18 01:06:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 01:06:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:06:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:06:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:06:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:06:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:06:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:06:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:06:54 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-18 01:07:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 01:07:19 [DEBUG   ] Got command RPT from MCS: ref #1201588
2019-01-18 01:07:19 [DEBUG   ] summary = ERROR
2019-01-18 01:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201588  13 58501  4039381 A  ERRORERROR'
2019-01-18 01:07:19 [DEBUG   ] Got command RPT from MCS: ref #1201589
2019-01-18 01:07:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201589  77 58501  4039585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:07:19 [DEBUG   ] Got command RPT from MCS: ref #1201590
2019-01-18 01:07:19 [DEBUG   ] summary = ERROR
2019-01-18 01:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201590  13 58501  4039789 A  ERRORERROR'
2019-01-18 01:07:19 [DEBUG   ] Got command RPT from MCS: ref #1201592
2019-01-18 01:07:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201592  77 58501  4039982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:07:20 [DEBUG   ] Got command RPT from MCS: ref #1201594
2019-01-18 01:07:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201594  12 58501  4040185 A  ERRORB•™š'
2019-01-18 01:07:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 01:07:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 01:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2019-01-18 01:07:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:07:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:07:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:07:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:07:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:07:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:07:54 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-18 01:08:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 01:08:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 01:08:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:08:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:08:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:08:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:08:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:08:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:08:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:08:54 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-18 01:09:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:09:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:09:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 01:09:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:09:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:09:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:09:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:09:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:09:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:09:54 [DEBUG   ] Finished updating board flags in 1.470 seconds
2019-01-18 01:10:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:10:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:10:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:10:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:10:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:10:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:10:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:10:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:10:54 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-01-18 01:11:05 [DEBUG   ] Got command RPT from MCS: ref #1201607
2019-01-18 01:11:05 [DEBUG   ] summary = ERROR
2019-01-18 01:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201607  13 58501  4265813 A  ERRORERROR'
2019-01-18 01:11:05 [DEBUG   ] Got command RPT from MCS: ref #1201608
2019-01-18 01:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201608  77 58501  4265814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:11:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 01:11:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:11:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:11:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:11:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:11:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:11:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:11:54 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-18 01:12:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 01:12:19 [DEBUG   ] Got command RPT from MCS: ref #1201624
2019-01-18 01:12:19 [DEBUG   ] summary = ERROR
2019-01-18 01:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201624  13 58501  4339469 A  ERRORERROR'
2019-01-18 01:12:19 [DEBUG   ] Got command RPT from MCS: ref #1201625
2019-01-18 01:12:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201625  77 58501  4339673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:12:19 [DEBUG   ] Got command RPT from MCS: ref #1201626
2019-01-18 01:12:19 [DEBUG   ] summary = ERROR
2019-01-18 01:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201626  13 58501  4339865 A  ERRORERROR'
2019-01-18 01:12:20 [DEBUG   ] Got command RPT from MCS: ref #1201627
2019-01-18 01:12:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201627  77 58501  4340069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:12:20 [DEBUG   ] Got command RPT from MCS: ref #1201628
2019-01-18 01:12:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201628  12 58501  4340273 A  ERRORB”™š'
2019-01-18 01:12:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 01:12:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:12:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:12:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:12:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:12:54 [WARNING ] (13, 1, 'bot')
2019-01-18 01:12:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:12:54 [DEBUG   ] Finished updating board flags in 1.520 seconds
2019-01-18 01:13:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 01:13:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 01:13:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 01:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:13:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:13:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:13:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:13:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:13:55 [DEBUG   ] Finished updating board flags in 2.199 seconds
2019-01-18 01:14:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 01:14:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 01:14:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 01:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:14:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:14:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:14:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:14:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:14:55 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-18 01:15:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:15:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:15:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:15:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:15:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 01:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:15:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:15:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:15:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:15:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:15:55 [DEBUG   ] Finished updating board flags in 1.892 seconds
2019-01-18 01:16:05 [DEBUG   ] Got command RPT from MCS: ref #1201637
2019-01-18 01:16:05 [DEBUG   ] summary = ERROR
2019-01-18 01:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201637  13 58501  4565813 A  ERRORERROR'
2019-01-18 01:16:05 [DEBUG   ] Got command RPT from MCS: ref #1201638
2019-01-18 01:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201638  77 58501  4565814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:16:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 01:16:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:16:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:16:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:16:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:16:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:16:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:16:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:16:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:16:55 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-18 01:17:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:17:19 [DEBUG   ] Got command RPT from MCS: ref #1201656
2019-01-18 01:17:19 [DEBUG   ] summary = ERROR
2019-01-18 01:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201656  13 58501  4639549 A  ERRORERROR'
2019-01-18 01:17:19 [DEBUG   ] Got command RPT from MCS: ref #1201657
2019-01-18 01:17:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201657  77 58501  4639753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:17:19 [DEBUG   ] Got command RPT from MCS: ref #1201658
2019-01-18 01:17:19 [DEBUG   ] summary = ERROR
2019-01-18 01:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201658  13 58501  4639957 A  ERRORERROR'
2019-01-18 01:17:20 [DEBUG   ] Got command RPT from MCS: ref #1201660
2019-01-18 01:17:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201660  77 58501  4640161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:17:20 [DEBUG   ] Got command RPT from MCS: ref #1201662
2019-01-18 01:17:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201662  12 58501  4640353 A  ERRORB–™š'
2019-01-18 01:17:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:17:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:17:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:17:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:17:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:17:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:17:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:17:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:17:55 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-01-18 01:18:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:18:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:18:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:18:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:18:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:18:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:18:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:18:55 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-18 01:19:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:19:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:19:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:19:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:19:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:19:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:19:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:19:55 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-18 01:20:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 01:20:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 01:20:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 01:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:20:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:20:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:20:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:20:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:20:55 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-18 01:21:05 [DEBUG   ] Got command RPT from MCS: ref #1201670
2019-01-18 01:21:05 [DEBUG   ] summary = ERROR
2019-01-18 01:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201670  13 58501  4865809 A  ERRORERROR'
2019-01-18 01:21:05 [DEBUG   ] Got command RPT from MCS: ref #1201671
2019-01-18 01:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201671  77 58501  4865810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:21:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 01:21:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 01:21:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 01:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:21:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:21:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:21:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:21:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:21:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:21:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:21:55 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-18 01:22:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 01:22:19 [DEBUG   ] Got command RPT from MCS: ref #1201691
2019-01-18 01:22:19 [DEBUG   ] summary = ERROR
2019-01-18 01:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201691  13 58501  4939645 A  ERRORERROR'
2019-01-18 01:22:19 [DEBUG   ] Got command RPT from MCS: ref #1201692
2019-01-18 01:22:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201692  77 58501  4939837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:22:20 [DEBUG   ] Got command RPT from MCS: ref #1201693
2019-01-18 01:22:20 [DEBUG   ] summary = ERROR
2019-01-18 01:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201693  13 58501  4940041 A  ERRORERROR'
2019-01-18 01:22:20 [DEBUG   ] Got command RPT from MCS: ref #1201694
2019-01-18 01:22:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201694  77 58501  4940245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:22:20 [DEBUG   ] Got command RPT from MCS: ref #1201695
2019-01-18 01:22:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201695  12 58501  4940437 A  ERRORB˜™š'
2019-01-18 01:22:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 01:22:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 01:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:22:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:22:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:22:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:22:55 [WARNING ] (13, 1, 'bot')
2019-01-18 01:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:22:55 [DEBUG   ] Finished updating board flags in 1.481 seconds
2019-01-18 01:23:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 01:23:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:23:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:23:56 [DEBUG   ] Finished updating board flags in 2.237 seconds
2019-01-18 01:24:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:24:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:24:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:24:56 [DEBUG   ] Finished updating board flags in 2.090 seconds
2019-01-18 01:25:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:25:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:25:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 01:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:25:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:25:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:25:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:25:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:25:56 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-01-18 01:26:05 [DEBUG   ] Got command RPT from MCS: ref #1201700
2019-01-18 01:26:05 [DEBUG   ] summary = ERROR
2019-01-18 01:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201700  13 58501  5165809 A  ERRORERROR'
2019-01-18 01:26:05 [DEBUG   ] Got command RPT from MCS: ref #1201701
2019-01-18 01:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201701  77 58501  5165810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:26:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:26:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:26:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:26:56 [DEBUG   ] Finished updating board flags in 1.971 seconds
2019-01-18 01:27:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:27:19 [DEBUG   ] Got command RPT from MCS: ref #1201719
2019-01-18 01:27:19 [DEBUG   ] summary = ERROR
2019-01-18 01:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201719  13 58501  5239725 A  ERRORERROR'
2019-01-18 01:27:19 [DEBUG   ] Got command RPT from MCS: ref #1201720
2019-01-18 01:27:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201720  77 58501  5239921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:27:20 [DEBUG   ] Got command RPT from MCS: ref #1201721
2019-01-18 01:27:20 [DEBUG   ] summary = ERROR
2019-01-18 01:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201721  13 58501  5240121 A  ERRORERROR'
2019-01-18 01:27:20 [DEBUG   ] Got command RPT from MCS: ref #1201723
2019-01-18 01:27:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201723  77 58501  5240325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:27:20 [DEBUG   ] Got command RPT from MCS: ref #1201724
2019-01-18 01:27:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201724  12 58501  5240529 A  ERRORB˜™š'
2019-01-18 01:27:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:27:50 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-18 01:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:27:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:27:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:27:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:27:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:27:56 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-18 01:28:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:28:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:28:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:28:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 01:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:28:56 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-18 01:29:10 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-18 01:29:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:29:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 01:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:29:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 01:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:29:56 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-18 01:30:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 01:30:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 01:30:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 01:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:30:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:30:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:30:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:30:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:30:56 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-18 01:31:05 [DEBUG   ] Got command RPT from MCS: ref #1201737
2019-01-18 01:31:05 [DEBUG   ] summary = ERROR
2019-01-18 01:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201737  13 58501  5465809 A  ERRORERROR'
2019-01-18 01:31:05 [DEBUG   ] Got command RPT from MCS: ref #1201738
2019-01-18 01:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201738  77 58501  5465810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:31:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 01:31:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:31:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:31:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:31:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:31:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:31:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:31:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:31:56 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-18 01:32:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:32:19 [DEBUG   ] Got command RPT from MCS: ref #1201754
2019-01-18 01:32:19 [DEBUG   ] summary = ERROR
2019-01-18 01:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201754  13 58501  5539813 A  ERRORERROR'
2019-01-18 01:32:20 [DEBUG   ] Got command RPT from MCS: ref #1201755
2019-01-18 01:32:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201755  77 58501  5540005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:32:20 [DEBUG   ] Got command RPT from MCS: ref #1201756
2019-01-18 01:32:20 [DEBUG   ] summary = ERROR
2019-01-18 01:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201756  13 58501  5540213 A  ERRORERROR'
2019-01-18 01:32:20 [DEBUG   ] Got command RPT from MCS: ref #1201757
2019-01-18 01:32:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201757  77 58501  5540405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:32:20 [DEBUG   ] Got command RPT from MCS: ref #1201758
2019-01-18 01:32:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201758  12 58501  5540609 A  ERRORB˜™š'
2019-01-18 01:32:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 01:32:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 01:32:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:32:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:32:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:32:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:32:56 [DEBUG   ] Finished updating board flags in 1.473 seconds
2019-01-18 01:33:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:33:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:33:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:33:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:33:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:33:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:33:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:33:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:33:56 [DEBUG   ] Finished updating board flags in 1.512 seconds
2019-01-18 01:34:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:34:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:34:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:34:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:34:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:34:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:34:56 [WARNING ] (13, 1, 'bot')
2019-01-18 01:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:34:56 [DEBUG   ] Finished updating board flags in 1.561 seconds
2019-01-18 01:35:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:35:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:35:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:35:57 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-01-18 01:36:05 [DEBUG   ] Got command RPT from MCS: ref #1201763
2019-01-18 01:36:05 [DEBUG   ] summary = ERROR
2019-01-18 01:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201763  13 58501  5765813 A  ERRORERROR'
2019-01-18 01:36:05 [DEBUG   ] Got command RPT from MCS: ref #1201764
2019-01-18 01:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201764  77 58501  5765814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:36:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 01:36:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 01:36:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 01:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:36:57 [DEBUG   ] Finished updating board flags in 1.875 seconds
2019-01-18 01:37:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 01:37:19 [DEBUG   ] Got command RPT from MCS: ref #1201786
2019-01-18 01:37:19 [DEBUG   ] summary = ERROR
2019-01-18 01:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201786  13 58501  5839889 A  ERRORERROR'
2019-01-18 01:37:20 [DEBUG   ] Got command RPT from MCS: ref #1201787
2019-01-18 01:37:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201787  77 58501  5840093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:37:20 [DEBUG   ] Got command RPT from MCS: ref #1201788
2019-01-18 01:37:20 [DEBUG   ] summary = ERROR
2019-01-18 01:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201788  13 58501  5840297 A  ERRORERROR'
2019-01-18 01:37:20 [DEBUG   ] Got command RPT from MCS: ref #1201790
2019-01-18 01:37:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201790  77 58501  5840489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:37:20 [DEBUG   ] Got command RPT from MCS: ref #1201791
2019-01-18 01:37:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201791  12 58501  5840693 A  ERRORB˜™š'
2019-01-18 01:37:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:37:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 01:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:37:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:37:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:37:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:37:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:37:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:37:57 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-18 01:38:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:38:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 01:38:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 01:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:38:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:38:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:38:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:38:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:38:57 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-18 01:39:11 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-01-18 01:39:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 01:39:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:39:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:39:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:39:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:39:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:39:57 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-18 01:40:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 01:40:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 01:40:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 01:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:40:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:40:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:40:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:40:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:40:57 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-18 01:41:05 [DEBUG   ] Got command RPT from MCS: ref #1201800
2019-01-18 01:41:05 [DEBUG   ] summary = ERROR
2019-01-18 01:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201800  13 58501  6065809 A  ERRORERROR'
2019-01-18 01:41:05 [DEBUG   ] Got command RPT from MCS: ref #1201801
2019-01-18 01:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201801  77 58501  6065810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:41:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 01:41:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 01:41:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:41:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:41:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:41:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:41:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:41:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:41:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:41:57 [DEBUG   ] Finished updating board flags in 1.708 seconds
2019-01-18 01:42:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:42:19 [DEBUG   ] Got command RPT from MCS: ref #1201817
2019-01-18 01:42:19 [DEBUG   ] summary = ERROR
2019-01-18 01:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201817  13 58501  6139981 A  ERRORERROR'
2019-01-18 01:42:20 [DEBUG   ] Got command RPT from MCS: ref #1201818
2019-01-18 01:42:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201818  77 58501  6140173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:42:20 [DEBUG   ] Got command RPT from MCS: ref #1201819
2019-01-18 01:42:20 [DEBUG   ] summary = ERROR
2019-01-18 01:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201819  13 58501  6140377 A  ERRORERROR'
2019-01-18 01:42:20 [DEBUG   ] Got command RPT from MCS: ref #1201820
2019-01-18 01:42:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201820  77 58501  6140581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:42:20 [DEBUG   ] Got command RPT from MCS: ref #1201821
2019-01-18 01:42:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201821  12 58501  6140785 A  ERRORB—™š'
2019-01-18 01:42:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:42:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 01:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:42:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:42:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:42:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:42:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:42:57 [DEBUG   ] Finished updating board flags in 1.491 seconds
2019-01-18 01:43:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:43:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 01:43:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:43:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 01:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:43:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:43:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:43:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:43:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:43:57 [DEBUG   ] Finished updating board flags in 1.474 seconds
2019-01-18 01:44:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 01:44:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 01:44:51 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 01:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:44:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:44:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:44:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:44:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:44:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:44:57 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-18 01:45:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 01:45:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 01:45:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 01:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:45:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:45:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:45:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:45:57 [WARNING ] (13, 1, 'bot')
2019-01-18 01:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:45:57 [DEBUG   ] Finished updating board flags in 1.485 seconds
2019-01-18 01:46:05 [DEBUG   ] Got command RPT from MCS: ref #1201830
2019-01-18 01:46:05 [DEBUG   ] summary = ERROR
2019-01-18 01:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201830  13 58501  6365813 A  ERRORERROR'
2019-01-18 01:46:05 [DEBUG   ] Got command RPT from MCS: ref #1201831
2019-01-18 01:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201831  77 58501  6365814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:46:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 01:46:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 01:46:52 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 01:46:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:46:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:46:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:46:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:46:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:46:58 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-01-18 01:47:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:47:20 [DEBUG   ] Got command RPT from MCS: ref #1201849
2019-01-18 01:47:20 [DEBUG   ] summary = ERROR
2019-01-18 01:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201849  13 58501  6440061 A  ERRORERROR'
2019-01-18 01:47:20 [DEBUG   ] Got command RPT from MCS: ref #1201850
2019-01-18 01:47:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201850  77 58501  6440265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:47:20 [DEBUG   ] Got command RPT from MCS: ref #1201851
2019-01-18 01:47:20 [DEBUG   ] summary = ERROR
2019-01-18 01:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201851  13 58501  6440469 A  ERRORERROR'
2019-01-18 01:47:20 [DEBUG   ] Got command RPT from MCS: ref #1201853
2019-01-18 01:47:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201853  77 58501  6440661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:47:20 [DEBUG   ] Got command RPT from MCS: ref #1201855
2019-01-18 01:47:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201855  12 58501  6440865 A  ERRORB™™š'
2019-01-18 01:47:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:47:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 01:47:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:47:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:47:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:47:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:47:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:47:58 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-18 01:48:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 01:48:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:48:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:48:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:48:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 01:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 01:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:48:58 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-18 01:49:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 01:49:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:49:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:49:58 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-18 01:50:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 01:50:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 01:50:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:50:58 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-18 01:51:05 [DEBUG   ] Got command RPT from MCS: ref #1201863
2019-01-18 01:51:05 [DEBUG   ] summary = ERROR
2019-01-18 01:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201863  13 58501  6665813 A  ERRORERROR'
2019-01-18 01:51:05 [DEBUG   ] Got command RPT from MCS: ref #1201864
2019-01-18 01:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201864  77 58501  6665814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:51:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 01:51:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:51:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 01:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:51:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:51:58 [DEBUG   ] Finished updating board flags in 1.689 seconds
2019-01-18 01:52:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 01:52:20 [DEBUG   ] Got command RPT from MCS: ref #1201884
2019-01-18 01:52:20 [DEBUG   ] summary = ERROR
2019-01-18 01:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201884  13 58501  6740153 A  ERRORERROR'
2019-01-18 01:52:20 [DEBUG   ] Got command RPT from MCS: ref #1201885
2019-01-18 01:52:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201885  77 58501  6740345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:52:20 [DEBUG   ] Got command RPT from MCS: ref #1201886
2019-01-18 01:52:20 [DEBUG   ] summary = ERROR
2019-01-18 01:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201886  13 58501  6740549 A  ERRORERROR'
2019-01-18 01:52:20 [DEBUG   ] Got command RPT from MCS: ref #1201887
2019-01-18 01:52:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201887  77 58501  6740753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:52:20 [DEBUG   ] Got command RPT from MCS: ref #1201888
2019-01-18 01:52:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201888  12 58501  6740957 A  ERRORB™™š'
2019-01-18 01:52:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 01:52:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 01:52:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:52:58 [DEBUG   ] Finished updating board flags in 1.575 seconds
2019-01-18 01:53:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 01:53:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:53:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 01:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:53:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:53:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:53:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:53:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:53:58 [DEBUG   ] Finished updating board flags in 1.525 seconds
2019-01-18 01:54:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 01:54:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 01:54:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 01:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:54:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:54:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:54:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:54:58 [WARNING ] (13, 1, 'bot')
2019-01-18 01:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:54:58 [DEBUG   ] Finished updating board flags in 1.525 seconds
2019-01-18 01:55:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-18 01:55:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 01:55:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 01:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 01:55:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:55:59 [DEBUG   ] Finished updating board flags in 2.161 seconds
2019-01-18 01:56:05 [DEBUG   ] Got command RPT from MCS: ref #1201893
2019-01-18 01:56:05 [DEBUG   ] summary = ERROR
2019-01-18 01:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201893  13 58501  6965813 A  ERRORERROR'
2019-01-18 01:56:05 [DEBUG   ] Got command RPT from MCS: ref #1201894
2019-01-18 01:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201894  77 58501  6965814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:56:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 01:56:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 01:56:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 01:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:56:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:56:59 [DEBUG   ] Finished updating board flags in 1.910 seconds
2019-01-18 01:57:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 01:57:20 [DEBUG   ] Got command RPT from MCS: ref #1201912
2019-01-18 01:57:20 [DEBUG   ] summary = ERROR
2019-01-18 01:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201912  13 58501  7040237 A  ERRORERROR'
2019-01-18 01:57:20 [DEBUG   ] Got command RPT from MCS: ref #1201913
2019-01-18 01:57:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201913  77 58501  7040441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:57:20 [DEBUG   ] Got command RPT from MCS: ref #1201914
2019-01-18 01:57:20 [DEBUG   ] summary = ERROR
2019-01-18 01:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201914  13 58501  7040633 A  ERRORERROR'
2019-01-18 01:57:20 [DEBUG   ] Got command RPT from MCS: ref #1201916
2019-01-18 01:57:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 01:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201916  77 58501  7040837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 01:57:21 [DEBUG   ] Got command RPT from MCS: ref #1201917
2019-01-18 01:57:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 01:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201917  12 58501  7041041 A  ERRORB˜™š'
2019-01-18 01:57:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 01:57:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:57:59 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-18 01:58:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 01:58:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:58:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:58:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:58:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:58:59 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-01-18 01:59:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:59:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 01:59:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 01:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 01:59:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:59:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:59:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:59:59 [WARNING ] (13, 1, 'bot')
2019-01-18 01:59:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 01:59:59 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-01-18 02:00:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:00:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:00:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:00:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:00:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:00:59 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-18 02:01:05 [DEBUG   ] Got command RPT from MCS: ref #1201930
2019-01-18 02:01:05 [DEBUG   ] summary = ERROR
2019-01-18 02:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201930  13 58501  7265817 A  ERRORERROR'
2019-01-18 02:01:05 [DEBUG   ] Got command RPT from MCS: ref #1201931
2019-01-18 02:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201931  77 58501  7265818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:01:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:01:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:01:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 02:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:01:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:01:59 [DEBUG   ] Finished updating board flags in 1.696 seconds
2019-01-18 02:02:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:02:20 [DEBUG   ] Got command RPT from MCS: ref #1201947
2019-01-18 02:02:20 [DEBUG   ] summary = ERROR
2019-01-18 02:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201947  13 58501  7340317 A  ERRORERROR'
2019-01-18 02:02:20 [DEBUG   ] Got command RPT from MCS: ref #1201948
2019-01-18 02:02:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201948  77 58501  7340521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:02:20 [DEBUG   ] Got command RPT from MCS: ref #1201949
2019-01-18 02:02:20 [DEBUG   ] summary = ERROR
2019-01-18 02:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201949  13 58501  7340725 A  ERRORERROR'
2019-01-18 02:02:20 [DEBUG   ] Got command RPT from MCS: ref #1201950
2019-01-18 02:02:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201950  77 58501  7340917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:02:21 [DEBUG   ] Got command RPT from MCS: ref #1201951
2019-01-18 02:02:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201951  12 58501  7341121 A  ERRORB—™š'
2019-01-18 02:02:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:02:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:02:59 [DEBUG   ] Finished updating board flags in 1.492 seconds
2019-01-18 02:03:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:03:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:03:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:03:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:03:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:03:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:03:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:03:59 [DEBUG   ] Finished updating board flags in 1.489 seconds
2019-01-18 02:04:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:04:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:04:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:04:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:04:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:04:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:04:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:04:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:04:59 [DEBUG   ] Finished updating board flags in 1.498 seconds
2019-01-18 02:05:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:05:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:05:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:05:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:05:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:05:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:05:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:05:59 [WARNING ] (13, 1, 'bot')
2019-01-18 02:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:05:59 [DEBUG   ] Finished updating board flags in 1.516 seconds
2019-01-18 02:06:05 [DEBUG   ] Got command RPT from MCS: ref #1201956
2019-01-18 02:06:05 [DEBUG   ] summary = ERROR
2019-01-18 02:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201956  13 58501  7565813 A  ERRORERROR'
2019-01-18 02:06:05 [DEBUG   ] Got command RPT from MCS: ref #1201957
2019-01-18 02:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201957  77 58501  7565814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:06:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:06:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:06:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:07:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 02:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:07:00 [DEBUG   ] Finished updating board flags in 2.205 seconds
2019-01-18 02:07:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:07:20 [DEBUG   ] Got command RPT from MCS: ref #1201979
2019-01-18 02:07:20 [DEBUG   ] summary = ERROR
2019-01-18 02:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201979  13 58501  7640409 A  ERRORERROR'
2019-01-18 02:07:20 [DEBUG   ] Got command RPT from MCS: ref #1201980
2019-01-18 02:07:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201980  77 58501  7640601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:07:20 [DEBUG   ] Got command RPT from MCS: ref #1201981
2019-01-18 02:07:20 [DEBUG   ] summary = ERROR
2019-01-18 02:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201981  13 58501  7640805 A  ERRORERROR'
2019-01-18 02:07:21 [DEBUG   ] Got command RPT from MCS: ref #1201983
2019-01-18 02:07:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201983  77 58501  7641009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:07:21 [DEBUG   ] Got command RPT from MCS: ref #1201984
2019-01-18 02:07:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201984  12 58501  7641213 A  ERRORB˜™š'
2019-01-18 02:07:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 02:07:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:08:00 [DEBUG   ] Finished updating board flags in 2.212 seconds
2019-01-18 02:08:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:08:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:08:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:08:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:09:00 [DEBUG   ] Finished updating board flags in 2.087 seconds
2019-01-18 02:09:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:09:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:09:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:10:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:10:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:10:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:10:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:10:00 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-18 02:10:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 02:10:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 02:10:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:11:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:11:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:11:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:11:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:11:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:11:00 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-18 02:11:05 [DEBUG   ] Got command RPT from MCS: ref #1201993
2019-01-18 02:11:05 [DEBUG   ] summary = ERROR
2019-01-18 02:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201993  13 58501  7865821 A  ERRORERROR'
2019-01-18 02:11:05 [DEBUG   ] Got command RPT from MCS: ref #1201994
2019-01-18 02:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1201994  77 58501  7865822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:11:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:11:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:11:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:12:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:12:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:12:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:12:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:12:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:12:00 [DEBUG   ] Finished updating board flags in 1.968 seconds
2019-01-18 02:12:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:12:20 [DEBUG   ] Got command RPT from MCS: ref #1202010
2019-01-18 02:12:20 [DEBUG   ] summary = ERROR
2019-01-18 02:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202010  13 58501  7940493 A  ERRORERROR'
2019-01-18 02:12:20 [DEBUG   ] Got command RPT from MCS: ref #1202011
2019-01-18 02:12:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202011  77 58501  7940697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:12:20 [DEBUG   ] Got command RPT from MCS: ref #1202012
2019-01-18 02:12:20 [DEBUG   ] summary = ERROR
2019-01-18 02:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202012  13 58501  7940889 A  ERRORERROR'
2019-01-18 02:12:21 [DEBUG   ] Got command RPT from MCS: ref #1202013
2019-01-18 02:12:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202013  77 58501  7941093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:12:21 [DEBUG   ] Got command RPT from MCS: ref #1202014
2019-01-18 02:12:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202014  12 58501  7941297 A  ERRORB™™š'
2019-01-18 02:12:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:12:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 02:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:13:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:13:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:13:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:13:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:13:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:13:00 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-18 02:13:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 02:13:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:13:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:14:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:14:00 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-18 02:14:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 02:14:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:14:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:15:00 [DEBUG   ] Finished updating board flags in 1.891 seconds
2019-01-18 02:15:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:15:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 02:15:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:16:00 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-18 02:16:05 [DEBUG   ] Got command RPT from MCS: ref #1202023
2019-01-18 02:16:05 [DEBUG   ] summary = ERROR
2019-01-18 02:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202023  13 58501  8165821 A  ERRORERROR'
2019-01-18 02:16:05 [DEBUG   ] Got command RPT from MCS: ref #1202024
2019-01-18 02:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202024  77 58501  8165822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:16:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:16:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:16:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 02:16:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:17:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:17:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:17:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:17:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:17:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:17:00 [DEBUG   ] Finished updating board flags in 1.669 seconds
2019-01-18 02:17:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:17:20 [DEBUG   ] Got command RPT from MCS: ref #1202042
2019-01-18 02:17:20 [DEBUG   ] summary = ERROR
2019-01-18 02:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202042  13 58501  8240577 A  ERRORERROR'
2019-01-18 02:17:20 [DEBUG   ] Got command RPT from MCS: ref #1202043
2019-01-18 02:17:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202043  77 58501  8240781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:17:20 [DEBUG   ] Got command RPT from MCS: ref #1202044
2019-01-18 02:17:20 [DEBUG   ] summary = ERROR
2019-01-18 02:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202044  13 58501  8240973 A  ERRORERROR'
2019-01-18 02:17:21 [DEBUG   ] Got command RPT from MCS: ref #1202046
2019-01-18 02:17:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202046  77 58501  8241177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:17:21 [DEBUG   ] Got command RPT from MCS: ref #1202047
2019-01-18 02:17:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202047  12 58501  8241381 A  ERRORB˜™š'
2019-01-18 02:17:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:17:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:17:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:18:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:18:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:18:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:18:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:18:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:18:00 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-18 02:18:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 02:18:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 02:18:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 02:18:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:19:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:19:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:19:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:19:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:19:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:19:00 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-18 02:19:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 02:19:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 02:19:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:20:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:20:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:20:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:20:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:20:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:20:00 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-18 02:20:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 02:20:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 02:20:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:21:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:21:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:21:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:21:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:21:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:21:00 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-18 02:21:05 [DEBUG   ] Got command RPT from MCS: ref #1202056
2019-01-18 02:21:05 [DEBUG   ] summary = ERROR
2019-01-18 02:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202056  13 58501  8465817 A  ERRORERROR'
2019-01-18 02:21:05 [DEBUG   ] Got command RPT from MCS: ref #1202057
2019-01-18 02:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202057  77 58501  8465818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:21:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:21:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 02:21:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:22:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:22:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:22:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:22:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:22:00 [WARNING ] (13, 1, 'bot')
2019-01-18 02:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:22:00 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-18 02:22:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:22:20 [DEBUG   ] Got command RPT from MCS: ref #1202077
2019-01-18 02:22:20 [DEBUG   ] summary = ERROR
2019-01-18 02:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202077  13 58501  8540665 A  ERRORERROR'
2019-01-18 02:22:20 [DEBUG   ] Got command RPT from MCS: ref #1202078
2019-01-18 02:22:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202078  77 58501  8540869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:22:21 [DEBUG   ] Got command RPT from MCS: ref #1202079
2019-01-18 02:22:21 [DEBUG   ] summary = ERROR
2019-01-18 02:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202079  13 58501  8541061 A  ERRORERROR'
2019-01-18 02:22:21 [DEBUG   ] Got command RPT from MCS: ref #1202080
2019-01-18 02:22:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202080  77 58501  8541265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:22:21 [DEBUG   ] Got command RPT from MCS: ref #1202081
2019-01-18 02:22:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202081  12 58501  8541469 A  ERRORB˜™š'
2019-01-18 02:22:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:22:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:23:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:23:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:23:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:23:01 [DEBUG   ] Finished updating board flags in 2.064 seconds
2019-01-18 02:23:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:23:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:23:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:24:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:24:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:24:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:24:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:24:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:24:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:24:01 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-18 02:24:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:24:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:24:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:25:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:25:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:25:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:25:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:25:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:25:01 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-01-18 02:25:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:25:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:25:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:26:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 02:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:26:01 [DEBUG   ] Finished updating board flags in 1.863 seconds
2019-01-18 02:26:05 [DEBUG   ] Got command RPT from MCS: ref #1202086
2019-01-18 02:26:05 [DEBUG   ] summary = ERROR
2019-01-18 02:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202086  13 58501  8765821 A  ERRORERROR'
2019-01-18 02:26:05 [DEBUG   ] Got command RPT from MCS: ref #1202087
2019-01-18 02:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202087  77 58501  8765822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:26:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:26:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:26:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:27:01 [DEBUG   ] Finished updating board flags in 1.777 seconds
2019-01-18 02:27:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:27:20 [DEBUG   ] Got command RPT from MCS: ref #1202105
2019-01-18 02:27:20 [DEBUG   ] summary = ERROR
2019-01-18 02:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202105  13 58501  8840749 A  ERRORERROR'
2019-01-18 02:27:20 [DEBUG   ] Got command RPT from MCS: ref #1202106
2019-01-18 02:27:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202106  77 58501  8840953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:27:21 [DEBUG   ] Got command RPT from MCS: ref #1202107
2019-01-18 02:27:21 [DEBUG   ] summary = ERROR
2019-01-18 02:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202107  13 58501  8841157 A  ERRORERROR'
2019-01-18 02:27:21 [DEBUG   ] Got command RPT from MCS: ref #1202109
2019-01-18 02:27:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202109  77 58501  8841349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:27:21 [DEBUG   ] Got command RPT from MCS: ref #1202110
2019-01-18 02:27:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202110  12 58501  8841553 A  ERRORB™™š'
2019-01-18 02:27:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:27:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:28:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:28:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:28:01 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-18 02:28:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:28:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:28:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:29:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:29:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:29:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:29:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:29:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:29:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:29:01 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-01-18 02:29:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:29:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:29:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:30:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:30:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:30:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:30:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:30:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:30:01 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-18 02:30:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:30:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:30:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:31:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:31:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:31:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:31:01 [WARNING ] (13, 1, 'bot')
2019-01-18 02:31:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:31:01 [DEBUG   ] Finished updating board flags in 1.562 seconds
2019-01-18 02:31:05 [DEBUG   ] Got command RPT from MCS: ref #1202123
2019-01-18 02:31:05 [DEBUG   ] summary = ERROR
2019-01-18 02:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202123  13 58501  9065821 A  ERRORERROR'
2019-01-18 02:31:05 [DEBUG   ] Got command RPT from MCS: ref #1202124
2019-01-18 02:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202124  77 58501  9065822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:31:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:31:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:31:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:32:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:32:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:32:02 [DEBUG   ] Finished updating board flags in 2.222 seconds
2019-01-18 02:32:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:32:20 [DEBUG   ] Got command RPT from MCS: ref #1202140
2019-01-18 02:32:20 [DEBUG   ] summary = ERROR
2019-01-18 02:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202140  13 58501  9140833 A  ERRORERROR'
2019-01-18 02:32:21 [DEBUG   ] Got command RPT from MCS: ref #1202141
2019-01-18 02:32:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202141  77 58501  9141037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:32:21 [DEBUG   ] Got command RPT from MCS: ref #1202142
2019-01-18 02:32:21 [DEBUG   ] summary = ERROR
2019-01-18 02:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202142  13 58501  9141241 A  ERRORERROR'
2019-01-18 02:32:21 [DEBUG   ] Got command RPT from MCS: ref #1202143
2019-01-18 02:32:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202143  77 58501  9141433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:32:21 [DEBUG   ] Got command RPT from MCS: ref #1202144
2019-01-18 02:32:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202144  12 58501  9141637 A  ERRORB˜™š'
2019-01-18 02:32:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:32:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:33:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:33:02 [DEBUG   ] Finished updating board flags in 2.219 seconds
2019-01-18 02:33:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:33:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:33:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:34:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:34:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:34:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:34:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:34:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:34:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:34:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:34:02 [DEBUG   ] Finished updating board flags in 2.070 seconds
2019-01-18 02:34:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:34:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:34:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:35:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:35:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:35:02 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-18 02:35:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:35:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:35:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:36:02 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-18 02:36:05 [DEBUG   ] Got command RPT from MCS: ref #1202149
2019-01-18 02:36:05 [DEBUG   ] summary = ERROR
2019-01-18 02:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202149  13 58501  9365821 A  ERRORERROR'
2019-01-18 02:36:05 [DEBUG   ] Got command RPT from MCS: ref #1202150
2019-01-18 02:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202150  77 58501  9365822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:36:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:36:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:36:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:37:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:37:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:37:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:37:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:37:02 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-18 02:37:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:37:20 [DEBUG   ] Got command RPT from MCS: ref #1202172
2019-01-18 02:37:20 [DEBUG   ] summary = ERROR
2019-01-18 02:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202172  13 58501  9440917 A  ERRORERROR'
2019-01-18 02:37:21 [DEBUG   ] Got command RPT from MCS: ref #1202173
2019-01-18 02:37:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202173  77 58501  9441121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:37:21 [DEBUG   ] Got command RPT from MCS: ref #1202174
2019-01-18 02:37:21 [DEBUG   ] summary = ERROR
2019-01-18 02:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202174  13 58501  9441325 A  ERRORERROR'
2019-01-18 02:37:21 [DEBUG   ] Got command RPT from MCS: ref #1202176
2019-01-18 02:37:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202176  77 58501  9441517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:37:21 [DEBUG   ] Got command RPT from MCS: ref #1202177
2019-01-18 02:37:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202177  12 58501  9441721 A  ERRORB˜™š'
2019-01-18 02:37:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:37:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:38:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:38:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:38:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:38:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:38:02 [DEBUG   ] Finished updating board flags in 1.902 seconds
2019-01-18 02:38:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:38:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:38:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:39:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:39:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:39:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:39:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:39:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:39:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:39:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:39:02 [DEBUG   ] Finished updating board flags in 1.699 seconds
2019-01-18 02:39:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:39:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:39:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:40:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:40:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 02:40:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:40:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:40:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:40:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:40:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:40:02 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-01-18 02:40:14 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-18 02:40:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 02:40:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 02:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:41:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:41:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:41:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:41:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:41:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:41:02 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-18 02:41:05 [DEBUG   ] Got command RPT from MCS: ref #1202186
2019-01-18 02:41:05 [DEBUG   ] summary = ERROR
2019-01-18 02:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202186  13 58501  9665829 A  ERRORERROR'
2019-01-18 02:41:05 [DEBUG   ] Got command RPT from MCS: ref #1202187
2019-01-18 02:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202187  77 58501  9665830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:41:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 02:41:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 02:41:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:42:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:42:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:42:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:42:02 [WARNING ] (13, 1, 'bot')
2019-01-18 02:42:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:42:02 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-18 02:42:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:42:21 [DEBUG   ] Got command RPT from MCS: ref #1202203
2019-01-18 02:42:21 [DEBUG   ] summary = ERROR
2019-01-18 02:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202203  13 58501  9741009 A  ERRORERROR'
2019-01-18 02:42:21 [DEBUG   ] Got command RPT from MCS: ref #1202204
2019-01-18 02:42:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202204  77 58501  9741213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:42:21 [DEBUG   ] Got command RPT from MCS: ref #1202205
2019-01-18 02:42:21 [DEBUG   ] summary = ERROR
2019-01-18 02:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202205  13 58501  9741405 A  ERRORERROR'
2019-01-18 02:42:21 [DEBUG   ] Got command RPT from MCS: ref #1202206
2019-01-18 02:42:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202206  77 58501  9741609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:42:21 [DEBUG   ] Got command RPT from MCS: ref #1202207
2019-01-18 02:42:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202207  12 58501  9741813 A  ERRORB™™š'
2019-01-18 02:42:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 02:42:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:43:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:43:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:43:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:43:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:43:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:43:03 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-18 02:43:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:43:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:43:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 02:44:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:44:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:44:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:44:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:44:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:44:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:44:03 [DEBUG   ] Finished updating board flags in 2.210 seconds
2019-01-18 02:44:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:44:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:44:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:45:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:45:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:45:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:45:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:45:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:45:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:45:03 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-18 02:45:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 02:45:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:45:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:46:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:46:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:46:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:46:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:46:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:46:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:46:03 [DEBUG   ] Finished updating board flags in 2.299 seconds
2019-01-18 02:46:05 [DEBUG   ] Got command RPT from MCS: ref #1202216
2019-01-18 02:46:05 [DEBUG   ] summary = ERROR
2019-01-18 02:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202216  13 58501  9965821 A  ERRORERROR'
2019-01-18 02:46:05 [DEBUG   ] Got command RPT from MCS: ref #1202217
2019-01-18 02:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202217  77 58501  9965822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:46:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 02:46:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 02:46:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:47:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:47:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:47:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:47:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:47:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:47:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:47:03 [DEBUG   ] Finished updating board flags in 2.075 seconds
2019-01-18 02:47:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 02:47:21 [DEBUG   ] Got command RPT from MCS: ref #1202235
2019-01-18 02:47:21 [DEBUG   ] summary = ERROR
2019-01-18 02:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202235  13 58501 10041089 A  ERRORERROR'
2019-01-18 02:47:21 [DEBUG   ] Got command RPT from MCS: ref #1202236
2019-01-18 02:47:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202236  77 58501 10041293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:47:21 [DEBUG   ] Got command RPT from MCS: ref #1202237
2019-01-18 02:47:21 [DEBUG   ] summary = ERROR
2019-01-18 02:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202237  13 58501 10041497 A  ERRORERROR'
2019-01-18 02:47:21 [DEBUG   ] Got command RPT from MCS: ref #1202239
2019-01-18 02:47:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202239  77 58501 10041689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:47:21 [DEBUG   ] Got command RPT from MCS: ref #1202240
2019-01-18 02:47:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202240  12 58501 10041908 A  ERRORB˜™š'
2019-01-18 02:47:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:47:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 02:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:48:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:48:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:48:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:48:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:48:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:48:03 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-18 02:48:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:48:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 02:48:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 02:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 02:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:49:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:49:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:49:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:49:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:49:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:49:03 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-18 02:49:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 02:49:35 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-18 02:49:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 02:50:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 02:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:50:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:50:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:50:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:50:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:50:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:50:03 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-18 02:50:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 02:50:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 02:50:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 02:51:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:51:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:51:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:51:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:51:03 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-18 02:51:05 [DEBUG   ] Got command RPT from MCS: ref #1202249
2019-01-18 02:51:05 [DEBUG   ] summary = ERROR
2019-01-18 02:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202249  13 58501 10265821 A  ERRORERROR'
2019-01-18 02:51:05 [DEBUG   ] Got command RPT from MCS: ref #1202250
2019-01-18 02:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202250  77 58501 10265822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:51:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:51:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:51:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:52:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:52:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:52:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:52:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:52:03 [DEBUG   ] Finished updating board flags in 1.833 seconds
2019-01-18 02:52:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:52:21 [DEBUG   ] Got command RPT from MCS: ref #1202270
2019-01-18 02:52:21 [DEBUG   ] summary = ERROR
2019-01-18 02:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202270  13 58501 10341181 A  ERRORERROR'
2019-01-18 02:52:21 [DEBUG   ] Got command RPT from MCS: ref #1202271
2019-01-18 02:52:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202271  77 58501 10341373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:52:21 [DEBUG   ] Got command RPT from MCS: ref #1202272
2019-01-18 02:52:21 [DEBUG   ] summary = ERROR
2019-01-18 02:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202272  13 58501 10341577 A  ERRORERROR'
2019-01-18 02:52:21 [DEBUG   ] Got command RPT from MCS: ref #1202273
2019-01-18 02:52:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202273  77 58501 10341781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:52:21 [DEBUG   ] Got command RPT from MCS: ref #1202274
2019-01-18 02:52:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202274  12 58501 10341985 A  ERRORB™™š'
2019-01-18 02:52:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:52:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:53:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:53:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:53:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:53:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:53:03 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-18 02:53:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 02:53:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 02:53:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 02:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:54:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 02:54:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:54:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:54:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:54:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:54:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:54:03 [DEBUG   ] Finished updating board flags in 1.753 seconds
2019-01-18 02:54:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:54:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 02:54:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 02:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:55:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:55:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:55:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:55:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:55:03 [DEBUG   ] Finished updating board flags in 1.641 seconds
2019-01-18 02:55:15 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-18 02:55:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:55:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 02:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 02:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 02:56:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:56:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:56:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:56:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:56:03 [DEBUG   ] Finished updating board flags in 1.541 seconds
2019-01-18 02:56:05 [DEBUG   ] Got command RPT from MCS: ref #1202279
2019-01-18 02:56:05 [DEBUG   ] summary = ERROR
2019-01-18 02:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202279  13 58501 10565833 A  ERRORERROR'
2019-01-18 02:56:05 [DEBUG   ] Got command RPT from MCS: ref #1202280
2019-01-18 02:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202280  77 58501 10565834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:56:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:56:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:56:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:57:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:57:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:57:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:57:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:57:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:57:03 [DEBUG   ] Finished updating board flags in 1.451 seconds
2019-01-18 02:57:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 02:57:21 [DEBUG   ] Got command RPT from MCS: ref #1202298
2019-01-18 02:57:21 [DEBUG   ] summary = ERROR
2019-01-18 02:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202298  13 58501 10641261 A  ERRORERROR'
2019-01-18 02:57:21 [DEBUG   ] Got command RPT from MCS: ref #1202299
2019-01-18 02:57:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202299  77 58501 10641465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:57:21 [DEBUG   ] Got command RPT from MCS: ref #1202300
2019-01-18 02:57:21 [DEBUG   ] summary = ERROR
2019-01-18 02:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202300  13 58501 10641669 A  ERRORERROR'
2019-01-18 02:57:21 [DEBUG   ] Got command RPT from MCS: ref #1202302
2019-01-18 02:57:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 02:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202302  77 58501 10641861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 02:57:22 [DEBUG   ] Got command RPT from MCS: ref #1202303
2019-01-18 02:57:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 02:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202303  12 58501 10642065 A  ERRORB™™š'
2019-01-18 02:57:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:57:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:58:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:58:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:58:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:58:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:58:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:58:03 [DEBUG   ] Finished updating board flags in 1.505 seconds
2019-01-18 02:58:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:58:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 02:58:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 02:59:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:59:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:59:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:59:03 [WARNING ] (13, 1, 'bot')
2019-01-18 02:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 02:59:03 [DEBUG   ] Finished updating board flags in 1.517 seconds
2019-01-18 02:59:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 02:59:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 02:59:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 03:00:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:00:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:00:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:00:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:00:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:00:04 [DEBUG   ] Finished updating board flags in 2.231 seconds
2019-01-18 03:00:15 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-18 03:00:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 03:00:56 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 03:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:01:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:01:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:01:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:01:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:01:04 [DEBUG   ] Finished updating board flags in 2.106 seconds
2019-01-18 03:01:05 [DEBUG   ] Got command RPT from MCS: ref #1202316
2019-01-18 03:01:05 [DEBUG   ] summary = ERROR
2019-01-18 03:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202316  13 58501 10865829 A  ERRORERROR'
2019-01-18 03:01:05 [DEBUG   ] Got command RPT from MCS: ref #1202317
2019-01-18 03:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202317  77 58501 10865830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:01:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 03:01:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:01:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 03:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:02:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:02:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:02:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:02:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:02:04 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-18 03:02:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 03:02:21 [DEBUG   ] Got command RPT from MCS: ref #1202333
2019-01-18 03:02:21 [DEBUG   ] summary = ERROR
2019-01-18 03:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202333  13 58501 10941353 A  ERRORERROR'
2019-01-18 03:02:21 [DEBUG   ] Got command RPT from MCS: ref #1202334
2019-01-18 03:02:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202334  77 58501 10941557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:02:21 [DEBUG   ] Got command RPT from MCS: ref #1202335
2019-01-18 03:02:21 [DEBUG   ] summary = ERROR
2019-01-18 03:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202335  13 58501 10941749 A  ERRORERROR'
2019-01-18 03:02:21 [DEBUG   ] Got command RPT from MCS: ref #1202336
2019-01-18 03:02:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202336  77 58501 10941953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:02:22 [DEBUG   ] Got command RPT from MCS: ref #1202337
2019-01-18 03:02:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202337  12 58501 10942157 A  ERRORB˜™š'
2019-01-18 03:02:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:02:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 03:03:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:03:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:03:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:03:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:03:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:03:04 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-18 03:03:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:03:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 03:03:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 03:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 03:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:04:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:04:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:04:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:04:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:04:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:04:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:04:04 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-18 03:04:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:04:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:04:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:05:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 03:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 03:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 03:05:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:05:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:05:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:05:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:05:04 [DEBUG   ] Finished updating board flags in 1.949 seconds
2019-01-18 03:05:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:05:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:05:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:06:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:06:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:06:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:06:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:06:04 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-18 03:06:05 [DEBUG   ] Got command RPT from MCS: ref #1202342
2019-01-18 03:06:05 [DEBUG   ] summary = ERROR
2019-01-18 03:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202342  13 58501 11165833 A  ERRORERROR'
2019-01-18 03:06:05 [DEBUG   ] Got command RPT from MCS: ref #1202343
2019-01-18 03:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202343  77 58501 11165834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:06:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 03:06:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 03:06:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:07:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 03:07:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 03:07:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:07:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:07:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:07:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:07:04 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-18 03:07:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:07:21 [DEBUG   ] Got command RPT from MCS: ref #1202365
2019-01-18 03:07:21 [DEBUG   ] summary = ERROR
2019-01-18 03:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202365  13 58501 11241441 A  ERRORERROR'
2019-01-18 03:07:21 [DEBUG   ] Got command RPT from MCS: ref #1202366
2019-01-18 03:07:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202366  77 58501 11241633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:07:21 [DEBUG   ] Got command RPT from MCS: ref #1202367
2019-01-18 03:07:21 [DEBUG   ] summary = ERROR
2019-01-18 03:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202367  13 58501 11241837 A  ERRORERROR'
2019-01-18 03:07:22 [DEBUG   ] Got command RPT from MCS: ref #1202369
2019-01-18 03:07:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202369  77 58501 11242041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:07:22 [DEBUG   ] Got command RPT from MCS: ref #1202371
2019-01-18 03:07:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202371  12 58501 11242233 A  ERRORB™™š'
2019-01-18 03:07:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:07:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:08:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:08:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:08:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:08:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:08:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:08:04 [DEBUG   ] Finished updating board flags in 1.651 seconds
2019-01-18 03:08:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 03:08:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:08:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 03:09:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:09:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:09:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:09:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:09:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:09:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:09:04 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-18 03:09:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:09:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 03:09:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:10:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:10:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:10:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:10:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:10:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:10:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:10:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:10:04 [DEBUG   ] Finished updating board flags in 1.532 seconds
2019-01-18 03:10:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 03:10:37 [DEBUG   ] Finished updating ant stats in 1.597 seconds
2019-01-18 03:10:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 03:11:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:11:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:11:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:11:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:11:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:11:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:11:04 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-01-18 03:11:05 [DEBUG   ] Got command RPT from MCS: ref #1202379
2019-01-18 03:11:05 [DEBUG   ] summary = ERROR
2019-01-18 03:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202379  13 58501 11465825 A  ERRORERROR'
2019-01-18 03:11:05 [DEBUG   ] Got command RPT from MCS: ref #1202380
2019-01-18 03:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202380  77 58501 11465826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:11:17 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-18 03:11:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 03:11:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 03:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:12:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:12:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:12:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:12:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:12:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:12:04 [DEBUG   ] Finished updating board flags in 1.485 seconds
2019-01-18 03:12:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 03:12:21 [DEBUG   ] Got command RPT from MCS: ref #1202396
2019-01-18 03:12:21 [DEBUG   ] summary = ERROR
2019-01-18 03:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202396  13 58501 11541525 A  ERRORERROR'
2019-01-18 03:12:21 [DEBUG   ] Got command RPT from MCS: ref #1202397
2019-01-18 03:12:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202397  77 58501 11541729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:12:21 [DEBUG   ] Got command RPT from MCS: ref #1202398
2019-01-18 03:12:21 [DEBUG   ] summary = ERROR
2019-01-18 03:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202398  13 58501 11541923 A  ERRORERROR'
2019-01-18 03:12:22 [DEBUG   ] Got command RPT from MCS: ref #1202399
2019-01-18 03:12:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202399  77 58501 11542125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:12:22 [DEBUG   ] Got command RPT from MCS: ref #1202400
2019-01-18 03:12:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202400  12 58501 11542329 A  ERRORB™™š'
2019-01-18 03:12:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 03:12:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 03:13:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:13:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:13:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:13:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:13:04 [WARNING ] (13, 1, 'bot')
2019-01-18 03:13:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:13:04 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-01-18 03:13:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:13:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 03:13:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 03:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:14:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:14:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:14:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:14:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:14:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:14:05 [DEBUG   ] Finished updating board flags in 2.188 seconds
2019-01-18 03:14:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 03:14:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:14:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:15:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:15:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:15:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:15:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:15:05 [DEBUG   ] Finished updating board flags in 1.943 seconds
2019-01-18 03:15:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 03:15:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:15:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:16:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:16:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:16:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:16:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:16:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:16:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:16:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:16:05 [DEBUG   ] Finished updating board flags in 1.854 seconds
2019-01-18 03:16:05 [DEBUG   ] Got command RPT from MCS: ref #1202409
2019-01-18 03:16:05 [DEBUG   ] summary = ERROR
2019-01-18 03:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202409  13 58501 11765833 A  ERRORERROR'
2019-01-18 03:16:05 [DEBUG   ] Got command RPT from MCS: ref #1202410
2019-01-18 03:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202410  77 58501 11765834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:16:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:16:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 03:16:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:17:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:17:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:17:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:17:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:17:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:17:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:17:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:17:05 [DEBUG   ] Finished updating board flags in 1.762 seconds
2019-01-18 03:17:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:17:21 [DEBUG   ] Got command RPT from MCS: ref #1202428
2019-01-18 03:17:21 [DEBUG   ] summary = ERROR
2019-01-18 03:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202428  13 58501 11841609 A  ERRORERROR'
2019-01-18 03:17:21 [DEBUG   ] Got command RPT from MCS: ref #1202429
2019-01-18 03:17:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202429  77 58501 11841813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:17:22 [DEBUG   ] Got command RPT from MCS: ref #1202430
2019-01-18 03:17:22 [DEBUG   ] summary = ERROR
2019-01-18 03:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202430  13 58501 11842005 A  ERRORERROR'
2019-01-18 03:17:22 [DEBUG   ] Got command RPT from MCS: ref #1202432
2019-01-18 03:17:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202432  77 58501 11842209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:17:22 [DEBUG   ] Got command RPT from MCS: ref #1202433
2019-01-18 03:17:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202433  12 58501 11842413 A  ERRORB˜™š'
2019-01-18 03:17:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:17:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:18:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 03:18:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:18:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:18:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:18:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:18:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:18:05 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-01-18 03:18:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:18:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:18:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:19:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:19:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:19:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:19:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:19:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:19:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:19:05 [DEBUG   ] Finished updating board flags in 1.648 seconds
2019-01-18 03:19:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:19:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:19:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:20:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:20:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:20:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:20:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:20:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:20:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:20:05 [DEBUG   ] Finished updating board flags in 1.509 seconds
2019-01-18 03:20:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 03:20:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 03:20:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:21:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:21:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:21:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:21:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:21:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:21:05 [DEBUG   ] Finished updating board flags in 1.488 seconds
2019-01-18 03:21:05 [DEBUG   ] Got command RPT from MCS: ref #1202442
2019-01-18 03:21:05 [DEBUG   ] summary = ERROR
2019-01-18 03:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202442  13 58501 12065833 A  ERRORERROR'
2019-01-18 03:21:05 [DEBUG   ] Got command RPT from MCS: ref #1202443
2019-01-18 03:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202443  77 58501 12065834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:21:17 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-18 03:21:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 03:21:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-18 03:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:22:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:22:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:22:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:22:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:22:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:22:05 [DEBUG   ] Finished updating board flags in 1.477 seconds
2019-01-18 03:22:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 03:22:21 [DEBUG   ] Got command RPT from MCS: ref #1202463
2019-01-18 03:22:21 [DEBUG   ] summary = ERROR
2019-01-18 03:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202463  13 58501 12141693 A  ERRORERROR'
2019-01-18 03:22:21 [DEBUG   ] Got command RPT from MCS: ref #1202464
2019-01-18 03:22:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202464  77 58501 12141897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:22:22 [DEBUG   ] Got command RPT from MCS: ref #1202465
2019-01-18 03:22:22 [DEBUG   ] summary = ERROR
2019-01-18 03:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202465  13 58501 12142089 A  ERRORERROR'
2019-01-18 03:22:22 [DEBUG   ] Got command RPT from MCS: ref #1202466
2019-01-18 03:22:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202466  77 58501 12142293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:22:22 [DEBUG   ] Got command RPT from MCS: ref #1202467
2019-01-18 03:22:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202467  12 58501 12142497 A  ERRORB™™š'
2019-01-18 03:22:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 03:22:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 03:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:23:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:23:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:23:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:23:05 [WARNING ] (13, 1, 'bot')
2019-01-18 03:23:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:23:05 [DEBUG   ] Finished updating board flags in 1.474 seconds
2019-01-18 03:23:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 03:23:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 03:23:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:24:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:24:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:24:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:24:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:24:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:24:06 [DEBUG   ] Finished updating board flags in 2.187 seconds
2019-01-18 03:24:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 03:24:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:24:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:25:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:25:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:25:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:25:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:25:06 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-01-18 03:25:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 03:25:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:25:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:26:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:26:05 [DEBUG   ] Got command RPT from MCS: ref #1202472
2019-01-18 03:26:05 [DEBUG   ] summary = ERROR
2019-01-18 03:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202472  13 58501 12365837 A  ERRORERROR'
2019-01-18 03:26:05 [DEBUG   ] Got command RPT from MCS: ref #1202473
2019-01-18 03:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202473  77 58501 12365838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:26:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:26:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:26:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:26:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:26:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:26:06 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-18 03:26:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:26:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:26:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:27:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:27:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:27:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:27:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:27:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:27:06 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-01-18 03:27:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:27:21 [DEBUG   ] Got command RPT from MCS: ref #1202491
2019-01-18 03:27:21 [DEBUG   ] summary = ERROR
2019-01-18 03:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202491  13 58501 12441781 A  ERRORERROR'
2019-01-18 03:27:21 [DEBUG   ] Got command RPT from MCS: ref #1202492
2019-01-18 03:27:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202492  77 58501 12441985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:27:22 [DEBUG   ] Got command RPT from MCS: ref #1202493
2019-01-18 03:27:22 [DEBUG   ] summary = ERROR
2019-01-18 03:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202493  13 58501 12442177 A  ERRORERROR'
2019-01-18 03:27:22 [DEBUG   ] Got command RPT from MCS: ref #1202495
2019-01-18 03:27:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202495  77 58501 12442381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:27:22 [DEBUG   ] Got command RPT from MCS: ref #1202497
2019-01-18 03:27:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202497  12 58501 12442585 A  ERRORB˜™š'
2019-01-18 03:27:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:27:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:28:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:28:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:28:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:28:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:28:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:28:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:28:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:28:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:28:06 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-18 03:28:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 03:28:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:28:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:29:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:29:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:29:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:29:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:29:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:29:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:29:06 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-18 03:29:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:29:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:29:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:30:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:30:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:30:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:30:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:30:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:30:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:30:06 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-01-18 03:30:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:30:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:30:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:31:05 [DEBUG   ] Got command RPT from MCS: ref #1202509
2019-01-18 03:31:05 [DEBUG   ] summary = ERROR
2019-01-18 03:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202509  13 58501 12665842 A  ERRORERROR'
2019-01-18 03:31:05 [DEBUG   ] Got command RPT from MCS: ref #1202510
2019-01-18 03:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202510  77 58501 12665842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:31:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:31:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:31:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:31:06 [WARNING ] (13, 1, 'bot')
2019-01-18 03:31:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:31:06 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-18 03:31:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:31:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:31:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:32:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:32:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:32:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:32:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:32:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:32:07 [DEBUG   ] Finished updating board flags in 2.280 seconds
2019-01-18 03:32:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:32:21 [DEBUG   ] Got command RPT from MCS: ref #1202526
2019-01-18 03:32:21 [DEBUG   ] summary = ERROR
2019-01-18 03:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202526  13 58501 12741873 A  ERRORERROR'
2019-01-18 03:32:22 [DEBUG   ] Got command RPT from MCS: ref #1202527
2019-01-18 03:32:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202527  77 58501 12742065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:32:22 [DEBUG   ] Got command RPT from MCS: ref #1202528
2019-01-18 03:32:22 [DEBUG   ] summary = ERROR
2019-01-18 03:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202528  13 58501 12742269 A  ERRORERROR'
2019-01-18 03:32:22 [DEBUG   ] Got command RPT from MCS: ref #1202529
2019-01-18 03:32:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202529  77 58501 12742473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:32:22 [DEBUG   ] Got command RPT from MCS: ref #1202530
2019-01-18 03:32:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202530  12 58501 12742678 A  ERRORB™™š'
2019-01-18 03:32:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:32:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 03:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 03:33:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:33:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:33:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:33:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:33:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:33:07 [DEBUG   ] Finished updating board flags in 2.115 seconds
2019-01-18 03:33:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:33:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 03:33:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:34:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:34:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:34:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:34:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:34:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:34:07 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-01-18 03:34:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:34:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:34:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 03:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 03:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:35:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:35:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:35:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:35:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:35:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:35:07 [DEBUG   ] Finished updating board flags in 1.971 seconds
2019-01-18 03:35:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:35:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:35:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:36:05 [DEBUG   ] Got command RPT from MCS: ref #1202535
2019-01-18 03:36:05 [DEBUG   ] summary = ERROR
2019-01-18 03:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202535  13 58501 12965837 A  ERRORERROR'
2019-01-18 03:36:05 [DEBUG   ] Got command RPT from MCS: ref #1202536
2019-01-18 03:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202536  77 58501 12965838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:36:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:36:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:36:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:36:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:36:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:36:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:36:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:36:07 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-18 03:36:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:36:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:36:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:37:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:37:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:37:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:37:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:37:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:37:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:37:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:37:07 [DEBUG   ] Finished updating board flags in 1.881 seconds
2019-01-18 03:37:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:37:21 [DEBUG   ] Got command RPT from MCS: ref #1202558
2019-01-18 03:37:21 [DEBUG   ] summary = ERROR
2019-01-18 03:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202558  13 58501 13041949 A  ERRORERROR'
2019-01-18 03:37:22 [DEBUG   ] Got command RPT from MCS: ref #1202559
2019-01-18 03:37:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202559  77 58501 13042153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:37:22 [DEBUG   ] Got command RPT from MCS: ref #1202560
2019-01-18 03:37:22 [DEBUG   ] summary = ERROR
2019-01-18 03:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202560  13 58501 13042357 A  ERRORERROR'
2019-01-18 03:37:22 [DEBUG   ] Got command RPT from MCS: ref #1202562
2019-01-18 03:37:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202562  77 58501 13042549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:37:22 [DEBUG   ] Got command RPT from MCS: ref #1202563
2019-01-18 03:37:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202563  12 58501 13042753 A  ERRORB™™š'
2019-01-18 03:37:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 03:37:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 03:38:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 03:38:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:38:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:38:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:38:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:38:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:38:07 [DEBUG   ] Finished updating board flags in 1.731 seconds
2019-01-18 03:38:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:38:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:38:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 03:39:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:39:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:39:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:39:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:39:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:39:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:39:07 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-18 03:39:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-18 03:39:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:39:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:40:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:40:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:40:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:40:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:40:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:40:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:40:07 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-18 03:40:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:40:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 03:40:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:41:05 [DEBUG   ] Got command RPT from MCS: ref #1202572
2019-01-18 03:41:05 [DEBUG   ] summary = ERROR
2019-01-18 03:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202572  13 58501 13265841 A  ERRORERROR'
2019-01-18 03:41:05 [DEBUG   ] Got command RPT from MCS: ref #1202573
2019-01-18 03:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202573  77 58501 13265842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:41:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:41:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:41:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:41:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:41:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:41:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:41:07 [DEBUG   ] Finished updating board flags in 1.493 seconds
2019-01-18 03:41:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:41:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:41:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:42:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:42:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:42:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:42:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:42:07 [WARNING ] (13, 1, 'bot')
2019-01-18 03:42:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:42:07 [DEBUG   ] Finished updating board flags in 1.532 seconds
2019-01-18 03:42:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:42:22 [DEBUG   ] Got command RPT from MCS: ref #1202589
2019-01-18 03:42:22 [DEBUG   ] summary = ERROR
2019-01-18 03:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202589  13 58501 13342042 A  ERRORERROR'
2019-01-18 03:42:22 [DEBUG   ] Got command RPT from MCS: ref #1202590
2019-01-18 03:42:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202590  77 58501 13342245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:42:22 [DEBUG   ] Got command RPT from MCS: ref #1202591
2019-01-18 03:42:22 [DEBUG   ] summary = ERROR
2019-01-18 03:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202591  13 58501 13342437 A  ERRORERROR'
2019-01-18 03:42:22 [DEBUG   ] Got command RPT from MCS: ref #1202592
2019-01-18 03:42:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202592  77 58501 13342641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:42:22 [DEBUG   ] Got command RPT from MCS: ref #1202593
2019-01-18 03:42:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202593  12 58501 13342845 A  ERRORB˜™š'
2019-01-18 03:42:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:42:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 03:43:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:43:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:43:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:43:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:43:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:43:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:43:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:43:08 [DEBUG   ] Finished updating board flags in 2.132 seconds
2019-01-18 03:43:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 03:43:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 03:43:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 03:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:44:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:44:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:44:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:44:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:44:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:44:08 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-18 03:44:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 03:44:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:44:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 03:45:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:45:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:45:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:45:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:45:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:45:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:45:08 [DEBUG   ] Finished updating board flags in 1.940 seconds
2019-01-18 03:45:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 03:45:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:45:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 03:46:05 [DEBUG   ] Got command RPT from MCS: ref #1202602
2019-01-18 03:46:05 [DEBUG   ] summary = ERROR
2019-01-18 03:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202602  13 58501 13565837 A  ERRORERROR'
2019-01-18 03:46:05 [DEBUG   ] Got command RPT from MCS: ref #1202603
2019-01-18 03:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202603  77 58501 13565838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:46:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:46:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:46:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:46:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:46:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:46:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:46:08 [DEBUG   ] Finished updating board flags in 1.868 seconds
2019-01-18 03:46:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 03:46:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 03:46:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:47:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:47:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:47:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:47:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:47:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:47:08 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-18 03:47:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:47:22 [DEBUG   ] Got command RPT from MCS: ref #1202621
2019-01-18 03:47:22 [DEBUG   ] summary = ERROR
2019-01-18 03:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202621  13 58501 13642125 A  ERRORERROR'
2019-01-18 03:47:22 [DEBUG   ] Got command RPT from MCS: ref #1202622
2019-01-18 03:47:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202622  77 58501 13642329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:47:22 [DEBUG   ] Got command RPT from MCS: ref #1202623
2019-01-18 03:47:22 [DEBUG   ] summary = ERROR
2019-01-18 03:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202623  13 58501 13642533 A  ERRORERROR'
2019-01-18 03:47:22 [DEBUG   ] Got command RPT from MCS: ref #1202625
2019-01-18 03:47:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202625  77 58501 13642725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:47:22 [DEBUG   ] Got command RPT from MCS: ref #1202626
2019-01-18 03:47:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202626  12 58501 13642929 A  ERRORB˜™š'
2019-01-18 03:47:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 03:47:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 03:48:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:48:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:48:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:48:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:48:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:48:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:48:08 [DEBUG   ] Finished updating board flags in 1.725 seconds
2019-01-18 03:48:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 03:48:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 03:48:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 03:49:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:49:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:49:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:49:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:49:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:49:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:49:08 [DEBUG   ] Finished updating board flags in 1.651 seconds
2019-01-18 03:49:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 03:49:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:49:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 03:50:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:50:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:50:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:50:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:50:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:50:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:50:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:50:08 [DEBUG   ] Finished updating board flags in 1.536 seconds
2019-01-18 03:50:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:50:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:50:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 03:51:05 [DEBUG   ] Got command RPT from MCS: ref #1202635
2019-01-18 03:51:05 [DEBUG   ] summary = ERROR
2019-01-18 03:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202635  13 58501 13865845 A  ERRORERROR'
2019-01-18 03:51:05 [DEBUG   ] Got command RPT from MCS: ref #1202636
2019-01-18 03:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202636  77 58501 13865846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:51:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:51:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:51:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:51:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:51:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:51:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:51:08 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-18 03:51:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 03:51:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:51:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:52:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:52:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:52:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:52:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:52:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:52:08 [WARNING ] (13, 1, 'bot')
2019-01-18 03:52:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:52:08 [DEBUG   ] Finished updating board flags in 1.538 seconds
2019-01-18 03:52:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:52:22 [DEBUG   ] Got command RPT from MCS: ref #1202656
2019-01-18 03:52:22 [DEBUG   ] summary = ERROR
2019-01-18 03:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202656  13 58501 13942217 A  ERRORERROR'
2019-01-18 03:52:22 [DEBUG   ] Got command RPT from MCS: ref #1202657
2019-01-18 03:52:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202657  77 58501 13942409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:52:22 [DEBUG   ] Got command RPT from MCS: ref #1202658
2019-01-18 03:52:22 [DEBUG   ] summary = ERROR
2019-01-18 03:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202658  13 58501 13942613 A  ERRORERROR'
2019-01-18 03:52:22 [DEBUG   ] Got command RPT from MCS: ref #1202659
2019-01-18 03:52:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202659  77 58501 13942817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:52:23 [DEBUG   ] Got command RPT from MCS: ref #1202660
2019-01-18 03:52:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202660  12 58501 13943021 A  ERRORB™™š'
2019-01-18 03:52:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 03:52:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 03:53:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:53:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:53:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:53:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:53:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:53:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:53:09 [DEBUG   ] Finished updating board flags in 2.277 seconds
2019-01-18 03:53:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 03:53:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 03:53:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 03:54:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:54:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:54:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:54:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:54:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:54:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:54:09 [DEBUG   ] Finished updating board flags in 2.250 seconds
2019-01-18 03:54:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 03:54:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 03:54:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 03:55:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:55:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:55:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:55:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:55:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:55:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:55:09 [DEBUG   ] Finished updating board flags in 2.080 seconds
2019-01-18 03:55:19 [DEBUG   ] Finished updating ant stats in 0.785 seconds
2019-01-18 03:55:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 03:55:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:56:05 [DEBUG   ] Got command RPT from MCS: ref #1202665
2019-01-18 03:56:05 [DEBUG   ] summary = ERROR
2019-01-18 03:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202665  13 58501 14165845 A  ERRORERROR'
2019-01-18 03:56:05 [DEBUG   ] Got command RPT from MCS: ref #1202666
2019-01-18 03:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202666  77 58501 14165846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:56:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:56:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:56:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:56:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:56:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:56:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:56:09 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-01-18 03:56:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:56:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 03:56:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:57:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:57:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:57:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:57:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:57:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:57:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:57:09 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-18 03:57:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:57:22 [DEBUG   ] Got command RPT from MCS: ref #1202684
2019-01-18 03:57:22 [DEBUG   ] summary = ERROR
2019-01-18 03:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202684  13 58501 14242293 A  ERRORERROR'
2019-01-18 03:57:22 [DEBUG   ] Got command RPT from MCS: ref #1202685
2019-01-18 03:57:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202685  77 58501 14242497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:57:22 [DEBUG   ] Got command RPT from MCS: ref #1202686
2019-01-18 03:57:22 [DEBUG   ] summary = ERROR
2019-01-18 03:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202686  13 58501 14242701 A  ERRORERROR'
2019-01-18 03:57:22 [DEBUG   ] Got command RPT from MCS: ref #1202688
2019-01-18 03:57:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 03:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202688  77 58501 14242905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 03:57:23 [DEBUG   ] Got command RPT from MCS: ref #1202689
2019-01-18 03:57:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 03:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202689  12 58501 14243097 A  ERRORB˜™š'
2019-01-18 03:57:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 03:57:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:58:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:58:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 03:58:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:58:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:58:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:58:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:58:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:58:09 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-18 03:58:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:58:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 03:58:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 03:59:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 03:59:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 03:59:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:59:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:59:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:59:09 [WARNING ] (13, 1, 'bot')
2019-01-18 03:59:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 03:59:09 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-18 03:59:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 03:59:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 03:59:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 04:00:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:00:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 04:00:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:00:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:00:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:00:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:00:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:00:09 [DEBUG   ] Finished updating board flags in 1.852 seconds
2019-01-18 04:00:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 04:00:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 04:01:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 04:01:05 [DEBUG   ] Got command RPT from MCS: ref #1202702
2019-01-18 04:01:05 [DEBUG   ] summary = ERROR
2019-01-18 04:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202702  13 58501 14465849 A  ERRORERROR'
2019-01-18 04:01:05 [DEBUG   ] Got command RPT from MCS: ref #1202703
2019-01-18 04:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202703  77 58501 14465850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:01:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:01:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:01:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:01:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:01:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:01:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:01:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:01:09 [DEBUG   ] Finished updating board flags in 1.728 seconds
2019-01-18 04:01:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 04:01:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:02:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:02:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:02:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:02:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:02:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:02:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:02:09 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-18 04:02:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:02:22 [DEBUG   ] Got command RPT from MCS: ref #1202719
2019-01-18 04:02:22 [DEBUG   ] summary = ERROR
2019-01-18 04:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202719  13 58501 14542389 A  ERRORERROR'
2019-01-18 04:02:22 [DEBUG   ] Got command RPT from MCS: ref #1202720
2019-01-18 04:02:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202720  77 58501 14542581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:02:22 [DEBUG   ] Got command RPT from MCS: ref #1202721
2019-01-18 04:02:22 [DEBUG   ] summary = ERROR
2019-01-18 04:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202721  13 58501 14542785 A  ERRORERROR'
2019-01-18 04:02:22 [DEBUG   ] Got command RPT from MCS: ref #1202722
2019-01-18 04:02:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202722  77 58501 14542989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:02:23 [DEBUG   ] Got command RPT from MCS: ref #1202723
2019-01-18 04:02:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202723  12 58501 14543181 A  ERRORB™™š'
2019-01-18 04:02:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:03:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 04:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:03:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:03:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:03:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:03:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:03:09 [DEBUG   ] Finished updating board flags in 1.657 seconds
2019-01-18 04:03:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:03:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:04:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 04:04:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:04:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:04:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:04:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:04:09 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-01-18 04:04:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:04:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:05:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:05:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:05:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:05:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:05:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:05:09 [DEBUG   ] Finished updating board flags in 1.485 seconds
2019-01-18 04:05:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:05:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:06:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 04:06:05 [DEBUG   ] Got command RPT from MCS: ref #1202728
2019-01-18 04:06:05 [DEBUG   ] summary = ERROR
2019-01-18 04:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202728  13 58501 14765849 A  ERRORERROR'
2019-01-18 04:06:05 [DEBUG   ] Got command RPT from MCS: ref #1202729
2019-01-18 04:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202729  77 58501 14765850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:06:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:06:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:06:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:06:09 [WARNING ] (13, 1, 'bot')
2019-01-18 04:06:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:06:09 [DEBUG   ] Finished updating board flags in 1.560 seconds
2019-01-18 04:06:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 04:06:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 04:07:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:07:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:07:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:07:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:07:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:07:10 [DEBUG   ] Finished updating board flags in 2.240 seconds
2019-01-18 04:07:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:07:22 [DEBUG   ] Got command RPT from MCS: ref #1202751
2019-01-18 04:07:22 [DEBUG   ] summary = ERROR
2019-01-18 04:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202751  13 58501 14842465 A  ERRORERROR'
2019-01-18 04:07:22 [DEBUG   ] Got command RPT from MCS: ref #1202752
2019-01-18 04:07:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202752  77 58501 14842669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:07:22 [DEBUG   ] Got command RPT from MCS: ref #1202753
2019-01-18 04:07:22 [DEBUG   ] summary = ERROR
2019-01-18 04:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202753  13 58501 14842873 A  ERRORERROR'
2019-01-18 04:07:23 [DEBUG   ] Got command RPT from MCS: ref #1202755
2019-01-18 04:07:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202755  77 58501 14843065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:07:23 [DEBUG   ] Got command RPT from MCS: ref #1202756
2019-01-18 04:07:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202756  12 58501 14843269 A  ERRORB™™š'
2019-01-18 04:07:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:08:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 04:08:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 04:08:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:08:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:08:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:08:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:08:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:08:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:08:10 [DEBUG   ] Finished updating board flags in 2.140 seconds
2019-01-18 04:08:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 04:08:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:09:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 04:09:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:09:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:09:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:09:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:09:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:09:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:09:10 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-01-18 04:09:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 04:09:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 04:10:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 04:10:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:10:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:10:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:10:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:10:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:10:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:10:10 [DEBUG   ] Finished updating board flags in 1.946 seconds
2019-01-18 04:10:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:10:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 04:11:00 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-18 04:11:05 [DEBUG   ] Got command RPT from MCS: ref #1202765
2019-01-18 04:11:05 [DEBUG   ] summary = ERROR
2019-01-18 04:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202765  13 58501 15065845 A  ERRORERROR'
2019-01-18 04:11:05 [DEBUG   ] Got command RPT from MCS: ref #1202766
2019-01-18 04:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202766  77 58501 15065846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:11:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:11:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 04:11:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:11:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:11:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:11:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:11:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:11:10 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-18 04:11:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:11:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:12:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 04:12:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:12:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:12:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:12:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:12:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:12:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:12:10 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-18 04:12:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 04:12:22 [DEBUG   ] Got command RPT from MCS: ref #1202782
2019-01-18 04:12:22 [DEBUG   ] summary = ERROR
2019-01-18 04:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202782  13 58501 15142549 A  ERRORERROR'
2019-01-18 04:12:22 [DEBUG   ] Got command RPT from MCS: ref #1202783
2019-01-18 04:12:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202783  77 58501 15142753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:12:22 [DEBUG   ] Got command RPT from MCS: ref #1202784
2019-01-18 04:12:22 [DEBUG   ] summary = ERROR
2019-01-18 04:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202784  13 58501 15142957 A  ERRORERROR'
2019-01-18 04:12:23 [DEBUG   ] Got command RPT from MCS: ref #1202785
2019-01-18 04:12:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202785  77 58501 15143161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:12:23 [DEBUG   ] Got command RPT from MCS: ref #1202786
2019-01-18 04:12:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202786  12 58501 15143353 A  ERRORB˜™š'
2019-01-18 04:12:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 04:13:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:13:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 04:13:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:13:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:13:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:13:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:13:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:13:10 [DEBUG   ] Finished updating board flags in 1.659 seconds
2019-01-18 04:13:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:13:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:14:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:14:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:14:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:14:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:14:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:14:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:14:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:14:10 [DEBUG   ] Finished updating board flags in 1.540 seconds
2019-01-18 04:14:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:14:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:15:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:15:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 04:15:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:15:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:15:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:15:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:15:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:15:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:15:10 [DEBUG   ] Finished updating board flags in 1.520 seconds
2019-01-18 04:15:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:15:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:16:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:16:05 [DEBUG   ] Got command RPT from MCS: ref #1202795
2019-01-18 04:16:05 [DEBUG   ] summary = ERROR
2019-01-18 04:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202795  13 58501 15365849 A  ERRORERROR'
2019-01-18 04:16:05 [DEBUG   ] Got command RPT from MCS: ref #1202796
2019-01-18 04:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202796  77 58501 15365850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:16:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:16:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:16:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:16:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:16:10 [WARNING ] (13, 1, 'bot')
2019-01-18 04:16:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:16:10 [DEBUG   ] Finished updating board flags in 1.540 seconds
2019-01-18 04:16:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:16:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 04:17:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 04:17:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 04:17:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 04:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 04:17:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:17:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:17:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:17:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:17:11 [DEBUG   ] Finished updating board flags in 2.221 seconds
2019-01-18 04:17:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:17:22 [DEBUG   ] Got command RPT from MCS: ref #1202814
2019-01-18 04:17:22 [DEBUG   ] summary = ERROR
2019-01-18 04:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202814  13 58501 15442637 A  ERRORERROR'
2019-01-18 04:17:22 [DEBUG   ] Got command RPT from MCS: ref #1202815
2019-01-18 04:17:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202815  77 58501 15442841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:17:23 [DEBUG   ] Got command RPT from MCS: ref #1202816
2019-01-18 04:17:23 [DEBUG   ] summary = ERROR
2019-01-18 04:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202816  13 58501 15443033 A  ERRORERROR'
2019-01-18 04:17:23 [DEBUG   ] Got command RPT from MCS: ref #1202818
2019-01-18 04:17:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202818  77 58501 15443237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:17:23 [DEBUG   ] Got command RPT from MCS: ref #1202819
2019-01-18 04:17:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202819  12 58501 15443441 A  ERRORB™™š'
2019-01-18 04:17:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:18:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:18:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:18:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:18:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:18:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:18:11 [DEBUG   ] Finished updating board flags in 2.123 seconds
2019-01-18 04:18:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:18:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:19:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:19:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:19:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:19:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:19:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:19:11 [DEBUG   ] Finished updating board flags in 2.063 seconds
2019-01-18 04:19:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:19:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:20:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:20:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:20:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:20:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:20:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:20:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:20:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:20:11 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-18 04:20:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:20:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:21:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:21:05 [DEBUG   ] Got command RPT from MCS: ref #1202828
2019-01-18 04:21:05 [DEBUG   ] summary = ERROR
2019-01-18 04:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202828  13 58501 15665845 A  ERRORERROR'
2019-01-18 04:21:05 [DEBUG   ] Got command RPT from MCS: ref #1202829
2019-01-18 04:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202829  77 58501 15665846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:21:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:21:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:21:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:21:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:21:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:21:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:21:11 [DEBUG   ] Finished updating board flags in 1.767 seconds
2019-01-18 04:21:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:21:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:22:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:22:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:22:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:22:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:22:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:22:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:22:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:22:11 [DEBUG   ] Finished updating board flags in 1.674 seconds
2019-01-18 04:22:20 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2019-01-18 04:22:22 [DEBUG   ] Got command RPT from MCS: ref #1202849
2019-01-18 04:22:22 [DEBUG   ] summary = ERROR
2019-01-18 04:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202849  13 58501 15742717 A  ERRORERROR'
2019-01-18 04:22:22 [DEBUG   ] Got command RPT from MCS: ref #1202850
2019-01-18 04:22:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202850  77 58501 15742921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:22:23 [DEBUG   ] Got command RPT from MCS: ref #1202851
2019-01-18 04:22:23 [DEBUG   ] summary = ERROR
2019-01-18 04:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202851  13 58501 15743125 A  ERRORERROR'
2019-01-18 04:22:23 [DEBUG   ] Got command RPT from MCS: ref #1202852
2019-01-18 04:22:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202852  77 58501 15743329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:22:23 [DEBUG   ] Got command RPT from MCS: ref #1202853
2019-01-18 04:22:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202853  12 58501 15743521 A  ERRORB˜™š'
2019-01-18 04:22:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 04:23:00 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 04:23:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:23:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:23:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:23:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:23:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:23:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:23:11 [DEBUG   ] Finished updating board flags in 1.523 seconds
2019-01-18 04:23:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 04:23:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 04:24:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 04:24:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 04:24:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:24:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:24:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:24:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:24:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:24:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:24:11 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-18 04:24:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 04:24:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:25:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:25:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:25:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:25:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:25:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:25:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:25:11 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-18 04:25:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 04:25:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:26:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 04:26:05 [DEBUG   ] Got command RPT from MCS: ref #1202858
2019-01-18 04:26:05 [DEBUG   ] summary = ERROR
2019-01-18 04:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202858  13 58501 15965853 A  ERRORERROR'
2019-01-18 04:26:05 [DEBUG   ] Got command RPT from MCS: ref #1202859
2019-01-18 04:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202859  77 58501 15965854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:26:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:26:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:26:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:26:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:26:11 [WARNING ] (13, 1, 'bot')
2019-01-18 04:26:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:26:11 [DEBUG   ] Finished updating board flags in 1.522 seconds
2019-01-18 04:26:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 04:26:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:27:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-18 04:27:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:27:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:27:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:27:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:27:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:27:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:27:12 [DEBUG   ] Finished updating board flags in 2.100 seconds
2019-01-18 04:27:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 04:27:22 [DEBUG   ] Got command RPT from MCS: ref #1202877
2019-01-18 04:27:22 [DEBUG   ] summary = ERROR
2019-01-18 04:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202877  13 58501 16042805 A  ERRORERROR'
2019-01-18 04:27:23 [DEBUG   ] Got command RPT from MCS: ref #1202878
2019-01-18 04:27:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202878  77 58501 16043009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:27:23 [DEBUG   ] Got command RPT from MCS: ref #1202879
2019-01-18 04:27:23 [DEBUG   ] summary = ERROR
2019-01-18 04:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202879  13 58501 16043213 A  ERRORERROR'
2019-01-18 04:27:23 [DEBUG   ] Got command RPT from MCS: ref #1202881
2019-01-18 04:27:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202881  77 58501 16043405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:27:23 [DEBUG   ] Got command RPT from MCS: ref #1202882
2019-01-18 04:27:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202882  12 58501 16043609 A  ERRORB˜™š'
2019-01-18 04:27:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:28:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-18 04:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:28:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:28:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:28:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:28:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:28:12 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-18 04:28:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 04:28:42 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-18 04:29:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 04:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:29:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:29:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:29:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:29:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:29:12 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-18 04:29:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 04:29:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 04:30:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 04:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 04:30:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:30:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:30:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:30:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:30:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:30:12 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-18 04:30:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 04:30:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 04:31:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 04:31:05 [DEBUG   ] Got command RPT from MCS: ref #1202895
2019-01-18 04:31:05 [DEBUG   ] summary = ERROR
2019-01-18 04:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202895  13 58501 16265857 A  ERRORERROR'
2019-01-18 04:31:05 [DEBUG   ] Got command RPT from MCS: ref #1202896
2019-01-18 04:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202896  77 58501 16265858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:31:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:31:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:31:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:31:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:31:12 [DEBUG   ] Finished updating board flags in 1.770 seconds
2019-01-18 04:31:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:31:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:32:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:32:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:32:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:32:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:32:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:32:12 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-18 04:32:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:32:22 [DEBUG   ] Got command RPT from MCS: ref #1202912
2019-01-18 04:32:22 [DEBUG   ] summary = ERROR
2019-01-18 04:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202912  13 58501 16342897 A  ERRORERROR'
2019-01-18 04:32:23 [DEBUG   ] Got command RPT from MCS: ref #1202913
2019-01-18 04:32:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202913  77 58501 16343101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:32:23 [DEBUG   ] Got command RPT from MCS: ref #1202914
2019-01-18 04:32:23 [DEBUG   ] summary = ERROR
2019-01-18 04:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202914  13 58501 16343293 A  ERRORERROR'
2019-01-18 04:32:23 [DEBUG   ] Got command RPT from MCS: ref #1202915
2019-01-18 04:32:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202915  77 58501 16343497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:32:23 [DEBUG   ] Got command RPT from MCS: ref #1202916
2019-01-18 04:32:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202916  12 58501 16343701 A  ERRORB™™š'
2019-01-18 04:32:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:33:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:33:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:33:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 04:33:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:33:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:33:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:33:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:33:12 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-18 04:33:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 04:33:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:34:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:34:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:34:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:34:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:34:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:34:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:34:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:34:12 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-18 04:34:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:34:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:35:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:35:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:35:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:35:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:35:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:35:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:35:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:35:12 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-18 04:35:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:35:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:36:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:36:05 [DEBUG   ] Got command RPT from MCS: ref #1202921
2019-01-18 04:36:05 [DEBUG   ] summary = ERROR
2019-01-18 04:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202921  13 58501 16565849 A  ERRORERROR'
2019-01-18 04:36:05 [DEBUG   ] Got command RPT from MCS: ref #1202922
2019-01-18 04:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202922  77 58501 16565850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:36:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:36:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:36:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:36:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:36:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:36:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:36:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:36:12 [DEBUG   ] Finished updating board flags in 1.668 seconds
2019-01-18 04:36:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:36:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:37:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:37:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:37:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:37:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:37:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:37:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:37:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:37:12 [DEBUG   ] Finished updating board flags in 1.501 seconds
2019-01-18 04:37:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:37:22 [DEBUG   ] Got command RPT from MCS: ref #1202944
2019-01-18 04:37:22 [DEBUG   ] summary = ERROR
2019-01-18 04:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202944  13 58501 16642977 A  ERRORERROR'
2019-01-18 04:37:23 [DEBUG   ] Got command RPT from MCS: ref #1202945
2019-01-18 04:37:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202945  77 58501 16643181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:37:23 [DEBUG   ] Got command RPT from MCS: ref #1202946
2019-01-18 04:37:23 [DEBUG   ] summary = ERROR
2019-01-18 04:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202946  13 58501 16643385 A  ERRORERROR'
2019-01-18 04:37:23 [DEBUG   ] Got command RPT from MCS: ref #1202948
2019-01-18 04:37:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202948  77 58501 16643577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:37:23 [DEBUG   ] Got command RPT from MCS: ref #1202950
2019-01-18 04:37:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202950  12 58501 16643781 A  ERRORB˜™š'
2019-01-18 04:37:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:38:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:38:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 04:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:38:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:38:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:38:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:38:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:38:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:38:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:38:12 [DEBUG   ] Finished updating board flags in 1.502 seconds
2019-01-18 04:38:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:38:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:39:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 04:39:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 04:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:39:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:39:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:39:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:39:12 [WARNING ] (13, 1, 'bot')
2019-01-18 04:39:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:39:12 [DEBUG   ] Finished updating board flags in 1.505 seconds
2019-01-18 04:39:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 04:39:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 04:40:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 04:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:40:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:40:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:40:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:40:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:40:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:40:13 [DEBUG   ] Finished updating board flags in 2.220 seconds
2019-01-18 04:40:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 04:40:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 04:41:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 04:41:05 [DEBUG   ] Got command RPT from MCS: ref #1202958
2019-01-18 04:41:05 [DEBUG   ] summary = ERROR
2019-01-18 04:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202958  13 58501 16865853 A  ERRORERROR'
2019-01-18 04:41:05 [DEBUG   ] Got command RPT from MCS: ref #1202959
2019-01-18 04:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202959  77 58501 16865854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:41:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:41:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:41:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:41:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:41:13 [DEBUG   ] Finished updating board flags in 2.176 seconds
2019-01-18 04:41:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:41:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:42:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 04:42:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:42:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:42:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:42:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:42:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:42:13 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-18 04:42:23 [DEBUG   ] Got command RPT from MCS: ref #1202975
2019-01-18 04:42:23 [DEBUG   ] summary = ERROR
2019-01-18 04:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202975  13 58501 16943069 A  ERRORERROR'
2019-01-18 04:42:23 [DEBUG   ] Got command RPT from MCS: ref #1202976
2019-01-18 04:42:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202976  77 58501 16943273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:42:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 04:42:23 [DEBUG   ] Got command RPT from MCS: ref #1202977
2019-01-18 04:42:23 [DEBUG   ] summary = ERROR
2019-01-18 04:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202977  13 58501 16943465 A  ERRORERROR'
2019-01-18 04:42:23 [DEBUG   ] Got command RPT from MCS: ref #1202978
2019-01-18 04:42:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202978  77 58501 16943669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:42:23 [DEBUG   ] Got command RPT from MCS: ref #1202979
2019-01-18 04:42:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202979  12 58501 16943873 A  ERRORB™™š'
2019-01-18 04:42:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:43:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:43:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:43:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:43:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:43:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:43:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:43:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:43:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:43:13 [DEBUG   ] Finished updating board flags in 2.080 seconds
2019-01-18 04:43:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 04:43:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 04:44:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:44:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:44:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:44:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:44:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:44:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:44:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:44:13 [DEBUG   ] Finished updating board flags in 1.933 seconds
2019-01-18 04:44:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:44:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 04:45:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 04:45:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:45:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:45:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:45:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:45:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:45:13 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-18 04:45:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:45:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 04:46:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 04:46:05 [DEBUG   ] Got command RPT from MCS: ref #1202988
2019-01-18 04:46:05 [DEBUG   ] summary = ERROR
2019-01-18 04:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202988  13 58501 17165861 A  ERRORERROR'
2019-01-18 04:46:05 [DEBUG   ] Got command RPT from MCS: ref #1202989
2019-01-18 04:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1202989  77 58501 17165862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:46:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:46:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 04:46:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:46:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:46:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:46:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:46:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:46:13 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-01-18 04:46:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 04:46:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 04:47:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 04:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:47:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:47:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:47:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:47:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:47:13 [DEBUG   ] Finished updating board flags in 1.741 seconds
2019-01-18 04:47:23 [DEBUG   ] Got command RPT from MCS: ref #1203007
2019-01-18 04:47:23 [DEBUG   ] summary = ERROR
2019-01-18 04:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203007  13 58501 17243157 A  ERRORERROR'
2019-01-18 04:47:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 04:47:23 [DEBUG   ] Got command RPT from MCS: ref #1203008
2019-01-18 04:47:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203008  77 58501 17243349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:47:23 [DEBUG   ] Got command RPT from MCS: ref #1203009
2019-01-18 04:47:23 [DEBUG   ] summary = ERROR
2019-01-18 04:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203009  13 58501 17243553 A  ERRORERROR'
2019-01-18 04:47:23 [DEBUG   ] Got command RPT from MCS: ref #1203011
2019-01-18 04:47:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203011  77 58501 17243757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:47:23 [DEBUG   ] Got command RPT from MCS: ref #1203012
2019-01-18 04:47:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203012  12 58501 17243961 A  ERRORB™™š'
2019-01-18 04:47:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 04:48:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:48:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:48:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 04:48:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:48:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:48:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:48:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:48:13 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-18 04:48:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 04:48:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 04:49:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:49:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:49:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:49:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:49:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:49:13 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-01-18 04:49:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:49:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:50:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 04:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:50:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:50:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:50:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:50:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:50:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:50:13 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-01-18 04:50:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:50:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 04:51:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 04:51:05 [DEBUG   ] Got command RPT from MCS: ref #1203021
2019-01-18 04:51:05 [DEBUG   ] summary = ERROR
2019-01-18 04:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203021  13 58501 17465857 A  ERRORERROR'
2019-01-18 04:51:05 [DEBUG   ] Got command RPT from MCS: ref #1203022
2019-01-18 04:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203022  77 58501 17465858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:51:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 04:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:51:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:51:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:51:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:51:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:51:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:51:13 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-18 04:51:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 04:51:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 04:52:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:52:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:52:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:52:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:52:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:52:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:52:13 [DEBUG   ] Finished updating board flags in 1.518 seconds
2019-01-18 04:52:23 [DEBUG   ] Got command RPT from MCS: ref #1203042
2019-01-18 04:52:23 [DEBUG   ] summary = ERROR
2019-01-18 04:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203042  13 58501 17543241 A  ERRORERROR'
2019-01-18 04:52:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:52:23 [DEBUG   ] Got command RPT from MCS: ref #1203043
2019-01-18 04:52:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203043  77 58501 17543445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:52:23 [DEBUG   ] Got command RPT from MCS: ref #1203044
2019-01-18 04:52:23 [DEBUG   ] summary = ERROR
2019-01-18 04:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203044  13 58501 17543637 A  ERRORERROR'
2019-01-18 04:52:23 [DEBUG   ] Got command RPT from MCS: ref #1203045
2019-01-18 04:52:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203045  77 58501 17543841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:52:24 [DEBUG   ] Got command RPT from MCS: ref #1203046
2019-01-18 04:52:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203046  12 58501 17544045 A  ERRORB˜™š'
2019-01-18 04:52:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:53:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:53:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:53:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:53:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:53:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:53:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:53:13 [DEBUG   ] Finished updating board flags in 1.518 seconds
2019-01-18 04:53:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:53:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:54:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:54:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:54:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:54:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:54:13 [WARNING ] (13, 1, 'bot')
2019-01-18 04:54:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:54:13 [DEBUG   ] Finished updating board flags in 1.542 seconds
2019-01-18 04:54:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:54:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:55:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:55:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:55:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:55:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:55:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:55:14 [DEBUG   ] Finished updating board flags in 2.223 seconds
2019-01-18 04:55:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:55:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:56:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:56:05 [DEBUG   ] Got command RPT from MCS: ref #1203051
2019-01-18 04:56:05 [DEBUG   ] summary = ERROR
2019-01-18 04:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203051  13 58501 17765865 A  ERRORERROR'
2019-01-18 04:56:05 [DEBUG   ] Got command RPT from MCS: ref #1203052
2019-01-18 04:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203052  77 58501 17765866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:56:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 04:56:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:56:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:56:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:56:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:56:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:56:14 [DEBUG   ] Finished updating board flags in 2.255 seconds
2019-01-18 04:56:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:56:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:57:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:57:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 04:57:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:57:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:57:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:57:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:57:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:57:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:57:14 [DEBUG   ] Finished updating board flags in 2.100 seconds
2019-01-18 04:57:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:57:23 [DEBUG   ] Got command RPT from MCS: ref #1203070
2019-01-18 04:57:23 [DEBUG   ] summary = ERROR
2019-01-18 04:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203070  13 58501 17843321 A  ERRORERROR'
2019-01-18 04:57:23 [DEBUG   ] Got command RPT from MCS: ref #1203071
2019-01-18 04:57:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203071  77 58501 17843525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:57:23 [DEBUG   ] Got command RPT from MCS: ref #1203072
2019-01-18 04:57:23 [DEBUG   ] summary = ERROR
2019-01-18 04:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203072  13 58501 17843729 A  ERRORERROR'
2019-01-18 04:57:23 [DEBUG   ] Got command RPT from MCS: ref #1203074
2019-01-18 04:57:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 04:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203074  77 58501 17843921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 04:57:24 [DEBUG   ] Got command RPT from MCS: ref #1203075
2019-01-18 04:57:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 04:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203075  12 58501 17844125 A  ERRORB™™š'
2019-01-18 04:57:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 04:58:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:58:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:58:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:58:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:58:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:58:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:58:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:58:14 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-18 04:58:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 04:58:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:59:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 04:59:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 04:59:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:59:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:59:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:59:14 [WARNING ] (13, 1, 'bot')
2019-01-18 04:59:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 04:59:14 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-18 04:59:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 04:59:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:00:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 05:00:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:00:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:00:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:00:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:00:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:00:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:00:14 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-18 05:00:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 05:00:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 05:01:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 05:01:05 [DEBUG   ] Got command RPT from MCS: ref #1203088
2019-01-18 05:01:05 [DEBUG   ] summary = ERROR
2019-01-18 05:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203088  13 58501 18065861 A  ERRORERROR'
2019-01-18 05:01:05 [DEBUG   ] Got command RPT from MCS: ref #1203089
2019-01-18 05:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203089  77 58501 18065862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:01:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:01:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:01:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:01:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:01:14 [DEBUG   ] Finished updating board flags in 1.855 seconds
2019-01-18 05:01:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:01:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 05:02:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 05:02:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:02:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:02:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:02:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:02:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:02:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:02:14 [DEBUG   ] Finished updating board flags in 1.848 seconds
2019-01-18 05:02:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 05:02:23 [DEBUG   ] Got command RPT from MCS: ref #1203105
2019-01-18 05:02:23 [DEBUG   ] summary = ERROR
2019-01-18 05:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203105  13 58501 18143413 A  ERRORERROR'
2019-01-18 05:02:23 [DEBUG   ] Got command RPT from MCS: ref #1203106
2019-01-18 05:02:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203106  77 58501 18143605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:02:23 [DEBUG   ] Got command RPT from MCS: ref #1203107
2019-01-18 05:02:23 [DEBUG   ] summary = ERROR
2019-01-18 05:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203107  13 58501 18143809 A  ERRORERROR'
2019-01-18 05:02:24 [DEBUG   ] Got command RPT from MCS: ref #1203108
2019-01-18 05:02:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203108  77 58501 18144013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:02:24 [DEBUG   ] Got command RPT from MCS: ref #1203109
2019-01-18 05:02:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203109  12 58501 18144217 A  ERRORB˜™š'
2019-01-18 05:02:43 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 05:03:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:03:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:03:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:03:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:03:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:03:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:03:14 [DEBUG   ] Finished updating board flags in 1.682 seconds
2019-01-18 05:03:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:03:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:04:04 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 05:04:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:04:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:04:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:04:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:04:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:04:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:04:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:04:14 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-18 05:04:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:04:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:05:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 05:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:05:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:05:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:05:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:05:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:05:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:05:14 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-18 05:05:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 05:05:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:06:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 05:06:05 [DEBUG   ] Got command RPT from MCS: ref #1203114
2019-01-18 05:06:05 [DEBUG   ] summary = ERROR
2019-01-18 05:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203114  13 58501 18365857 A  ERRORERROR'
2019-01-18 05:06:05 [DEBUG   ] Got command RPT from MCS: ref #1203115
2019-01-18 05:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203115  77 58501 18365858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:06:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:06:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:06:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:06:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:06:14 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-18 05:06:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:06:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:07:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 05:07:11 [DEBUG   ] Got command TBW from MCS: ref #1203138
2019-01-18 05:07:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-18 05:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1203138   8 58501 18431250 A  ERROR'
2019-01-18 05:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-18 05:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-18 05:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-18 05:07:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:07:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:07:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:07:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:07:14 [DEBUG   ] Finished updating board flags in 1.467 seconds
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-18 05:07:14 [DEBUG   ] spawn_process: at 2019-01-18 05:07:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-18 05:07:14 [INFO    ] Finished spawning TBW
2019-01-18 05:07:23 [DEBUG   ] Got command RPT from MCS: ref #1203140
2019-01-18 05:07:23 [DEBUG   ] summary = ERROR
2019-01-18 05:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203140  13 58501 18443489 A  ERRORERROR'
2019-01-18 05:07:23 [DEBUG   ] Got command RPT from MCS: ref #1203141
2019-01-18 05:07:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203141  77 58501 18443693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:07:23 [DEBUG   ] Got command RPT from MCS: ref #1203142
2019-01-18 05:07:23 [DEBUG   ] summary = ERROR
2019-01-18 05:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203142  13 58501 18443897 A  ERRORERROR'
2019-01-18 05:07:24 [DEBUG   ] Got command RPT from MCS: ref #1203144
2019-01-18 05:07:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203144  77 58501 18444101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:07:24 [DEBUG   ] Got command RPT from MCS: ref #1203146
2019-01-18 05:07:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203146  12 58501 18444293 A  ERRORB™™š'
2019-01-18 05:08:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:08:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:08:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:08:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:08:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:08:14 [WARNING ] (13, 1, 'bot')
2019-01-18 05:08:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:08:14 [DEBUG   ] Finished updating board flags in 1.284 seconds
2019-01-18 05:09:03 [INFO    ] __waitForTBW - TBW finished in 108.714 s
2019-01-18 05:09:04 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2019-01-18 05:09:04 [INFO    ] Started antennas statistics background thread
2019-01-18 05:09:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547788146']
2019-01-18 05:09:04 [DEBUG   ] spawn_process: at 2019-01-18 05:09:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547788146']
2019-01-18 05:09:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-18 05:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:09:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:09:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:09:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:09:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:09:15 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-18 05:09:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2019-01-18 05:09:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 05:10:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 05:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:10:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:10:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:10:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:10:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:10:15 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-18 05:10:25 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-18 05:10:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:11:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 05:11:05 [DEBUG   ] Got command RPT from MCS: ref #1203160
2019-01-18 05:11:05 [DEBUG   ] summary = ERROR
2019-01-18 05:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203160  13 58501 18665861 A  ERRORERROR'
2019-01-18 05:11:05 [DEBUG   ] Got command RPT from MCS: ref #1203161
2019-01-18 05:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203161  77 58501 18665862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:11:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:11:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:11:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:11:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:11:15 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-18 05:11:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:11:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:12:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:12:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:12:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:12:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:12:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:12:15 [DEBUG   ] Finished updating board flags in 2.334 seconds
2019-01-18 05:12:23 [DEBUG   ] Got command RPT from MCS: ref #1203177
2019-01-18 05:12:23 [DEBUG   ] summary = ERROR
2019-01-18 05:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203177  13 58501 18743585 A  ERRORERROR'
2019-01-18 05:12:23 [DEBUG   ] Got command RPT from MCS: ref #1203178
2019-01-18 05:12:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203178  77 58501 18743777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:12:23 [DEBUG   ] Got command RPT from MCS: ref #1203179
2019-01-18 05:12:23 [DEBUG   ] summary = ERROR
2019-01-18 05:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203179  13 58501 18743981 A  ERRORERROR'
2019-01-18 05:12:24 [DEBUG   ] Got command RPT from MCS: ref #1203180
2019-01-18 05:12:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203180  77 58501 18744185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:12:24 [DEBUG   ] Got command RPT from MCS: ref #1203181
2019-01-18 05:12:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203181  12 58501 18744385 A  ERRORB™™š'
2019-01-18 05:12:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 05:12:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 05:13:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:13:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:13:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:13:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:13:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:13:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:13:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:13:15 [DEBUG   ] Finished updating board flags in 2.210 seconds
2019-01-18 05:13:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:13:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:14:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 05:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:14:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:14:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:14:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:14:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:14:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:14:15 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-18 05:14:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:14:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:15:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:15:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:15:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:15:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:15:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:15:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:15:15 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-18 05:15:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 05:15:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:16:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 05:16:05 [DEBUG   ] Got command RPT from MCS: ref #1203190
2019-01-18 05:16:05 [DEBUG   ] summary = ERROR
2019-01-18 05:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203190  13 58501 18965869 A  ERRORERROR'
2019-01-18 05:16:05 [DEBUG   ] Got command RPT from MCS: ref #1203191
2019-01-18 05:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203191  77 58501 18965870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:16:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:16:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:16:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:16:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:16:15 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-18 05:16:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:16:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 05:17:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:17:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:17:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:17:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:17:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:17:15 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-18 05:17:23 [DEBUG   ] Got command RPT from MCS: ref #1203209
2019-01-18 05:17:23 [DEBUG   ] summary = ERROR
2019-01-18 05:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203209  13 58501 19043669 A  ERRORERROR'
2019-01-18 05:17:23 [DEBUG   ] Got command RPT from MCS: ref #1203210
2019-01-18 05:17:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203210  77 58501 19043873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:17:24 [DEBUG   ] Got command RPT from MCS: ref #1203211
2019-01-18 05:17:24 [DEBUG   ] summary = ERROR
2019-01-18 05:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203211  13 58501 19044065 A  ERRORERROR'
2019-01-18 05:17:24 [DEBUG   ] Got command RPT from MCS: ref #1203213
2019-01-18 05:17:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203213  77 58501 19044269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:17:24 [DEBUG   ] Got command RPT from MCS: ref #1203215
2019-01-18 05:17:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203215  12 58501 19044473 A  ERRORB˜™š'
2019-01-18 05:17:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:17:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 05:18:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 05:18:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:18:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:18:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:18:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:18:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:18:15 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-18 05:18:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:18:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:19:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 05:19:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:19:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:19:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:19:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:19:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:19:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:19:15 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-18 05:19:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 05:19:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 05:20:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 05:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 05:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:20:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:20:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:20:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:20:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:20:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:20:15 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-18 05:20:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-18 05:20:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-18 05:21:05 [DEBUG   ] Got command RPT from MCS: ref #1203223
2019-01-18 05:21:05 [DEBUG   ] summary = ERROR
2019-01-18 05:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203223  13 58501 19265861 A  ERRORERROR'
2019-01-18 05:21:05 [DEBUG   ] Got command RPT from MCS: ref #1203224
2019-01-18 05:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203224  77 58501 19265862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:21:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 05:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:21:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:21:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:21:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:21:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:21:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:21:15 [DEBUG   ] Finished updating board flags in 1.573 seconds
2019-01-18 05:21:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:21:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 05:22:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:22:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:22:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:22:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:22:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:22:15 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-01-18 05:22:23 [DEBUG   ] Got command RPT from MCS: ref #1203244
2019-01-18 05:22:23 [DEBUG   ] summary = ERROR
2019-01-18 05:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203244  13 58501 19343757 A  ERRORERROR'
2019-01-18 05:22:23 [DEBUG   ] Got command RPT from MCS: ref #1203245
2019-01-18 05:22:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203245  77 58501 19343949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:22:24 [DEBUG   ] Got command RPT from MCS: ref #1203246
2019-01-18 05:22:24 [DEBUG   ] summary = ERROR
2019-01-18 05:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203246  13 58501 19344153 A  ERRORERROR'
2019-01-18 05:22:24 [DEBUG   ] Got command RPT from MCS: ref #1203247
2019-01-18 05:22:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203247  77 58501 19344357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:22:24 [DEBUG   ] Got command RPT from MCS: ref #1203248
2019-01-18 05:22:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203248  12 58501 19344561 A  ERRORB˜™š'
2019-01-18 05:22:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:22:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:23:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 05:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 05:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 05:23:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:23:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:23:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:23:15 [WARNING ] (13, 1, 'bot')
2019-01-18 05:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:23:15 [DEBUG   ] Finished updating board flags in 1.565 seconds
2019-01-18 05:23:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:23:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:24:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:24:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:24:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:24:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:24:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:24:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:24:16 [DEBUG   ] Finished updating board flags in 2.429 seconds
2019-01-18 05:24:26 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-18 05:24:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 05:25:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:25:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:25:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:25:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:25:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:25:16 [DEBUG   ] Finished updating board flags in 2.138 seconds
2019-01-18 05:25:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:25:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 05:26:05 [DEBUG   ] Got command RPT from MCS: ref #1203253
2019-01-18 05:26:05 [DEBUG   ] summary = ERROR
2019-01-18 05:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203253  13 58501 19565865 A  ERRORERROR'
2019-01-18 05:26:05 [DEBUG   ] Got command RPT from MCS: ref #1203254
2019-01-18 05:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203254  77 58501 19565866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:26:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:26:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:26:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:26:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:26:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:26:16 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-18 05:26:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 05:26:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-18 05:27:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 05:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:27:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 05:27:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:27:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:27:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:27:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:27:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:27:16 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-18 05:27:23 [DEBUG   ] Got command RPT from MCS: ref #1203272
2019-01-18 05:27:23 [DEBUG   ] summary = ERROR
2019-01-18 05:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203272  13 58501 19643845 A  ERRORERROR'
2019-01-18 05:27:24 [DEBUG   ] Got command RPT from MCS: ref #1203273
2019-01-18 05:27:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203273  77 58501 19644037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:27:24 [DEBUG   ] Got command RPT from MCS: ref #1203274
2019-01-18 05:27:24 [DEBUG   ] summary = ERROR
2019-01-18 05:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203274  13 58501 19644241 A  ERRORERROR'
2019-01-18 05:27:24 [DEBUG   ] Got command RPT from MCS: ref #1203276
2019-01-18 05:27:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203276  77 58501 19644445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:27:24 [DEBUG   ] Got command RPT from MCS: ref #1203277
2019-01-18 05:27:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203277  12 58501 19644637 A  ERRORB˜™š'
2019-01-18 05:27:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 05:27:46 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2019-01-18 05:28:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-18 05:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:28:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:28:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:28:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:28:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:28:16 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-01-18 05:28:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 05:28:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 05:29:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 05:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:29:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:29:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:29:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:29:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:29:16 [DEBUG   ] Finished updating board flags in 1.754 seconds
2019-01-18 05:29:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:29:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:30:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:30:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:30:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:30:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:30:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:30:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:30:16 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-18 05:30:27 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-18 05:30:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:31:05 [DEBUG   ] Got command RPT from MCS: ref #1203290
2019-01-18 05:31:05 [DEBUG   ] summary = ERROR
2019-01-18 05:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203290  13 58501 19865873 A  ERRORERROR'
2019-01-18 05:31:05 [DEBUG   ] Got command RPT from MCS: ref #1203291
2019-01-18 05:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203291  77 58501 19865874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:31:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:31:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:31:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:31:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:31:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:31:16 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-18 05:31:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 05:31:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:32:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 05:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:32:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:32:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:32:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:32:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:32:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:32:16 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-18 05:32:23 [DEBUG   ] Got command RPT from MCS: ref #1203307
2019-01-18 05:32:23 [DEBUG   ] summary = ERROR
2019-01-18 05:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203307  13 58501 19943933 A  ERRORERROR'
2019-01-18 05:32:24 [DEBUG   ] Got command RPT from MCS: ref #1203308
2019-01-18 05:32:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203308  77 58501 19944125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:32:24 [DEBUG   ] Got command RPT from MCS: ref #1203309
2019-01-18 05:32:24 [DEBUG   ] summary = ERROR
2019-01-18 05:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203309  13 58501 19944329 A  ERRORERROR'
2019-01-18 05:32:24 [DEBUG   ] Got command RPT from MCS: ref #1203310
2019-01-18 05:32:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203310  77 58501 19944533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:32:24 [DEBUG   ] Got command RPT from MCS: ref #1203311
2019-01-18 05:32:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203311  12 58501 19944737 A  ERRORB˜™š'
2019-01-18 05:32:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:32:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 05:33:07 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2019-01-18 05:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:33:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:33:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:33:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:33:16 [WARNING ] (13, 1, 'bot')
2019-01-18 05:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:33:16 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-01-18 05:33:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 05:33:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:34:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:34:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 05:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:34:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:34:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:34:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:34:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:34:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:34:17 [DEBUG   ] Finished updating board flags in 2.069 seconds
2019-01-18 05:34:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 05:34:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 05:35:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:35:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:35:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:35:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:35:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:35:17 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-18 05:35:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 05:35:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 05:36:05 [DEBUG   ] Got command RPT from MCS: ref #1203316
2019-01-18 05:36:05 [DEBUG   ] summary = ERROR
2019-01-18 05:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203316  13 58501 20165873 A  ERRORERROR'
2019-01-18 05:36:05 [DEBUG   ] Got command RPT from MCS: ref #1203317
2019-01-18 05:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203317  77 58501 20165874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:36:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 05:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 05:36:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:36:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:36:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:36:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:36:17 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-18 05:36:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 05:36:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:37:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 05:37:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:37:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:37:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:37:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:37:17 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-18 05:37:24 [DEBUG   ] Got command RPT from MCS: ref #1203339
2019-01-18 05:37:24 [DEBUG   ] summary = ERROR
2019-01-18 05:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203339  13 58501 20244013 A  ERRORERROR'
2019-01-18 05:37:24 [DEBUG   ] Got command RPT from MCS: ref #1203340
2019-01-18 05:37:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203340  77 58501 20244217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:37:24 [DEBUG   ] Got command RPT from MCS: ref #1203341
2019-01-18 05:37:24 [DEBUG   ] summary = ERROR
2019-01-18 05:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203341  13 58501 20244409 A  ERRORERROR'
2019-01-18 05:37:24 [DEBUG   ] Got command RPT from MCS: ref #1203343
2019-01-18 05:37:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203343  77 58501 20244613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:37:24 [DEBUG   ] Got command RPT from MCS: ref #1203345
2019-01-18 05:37:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203345  12 58501 20244817 A  ERRORB™™š'
2019-01-18 05:37:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:37:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:38:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:38:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 05:38:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:38:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:38:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:38:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:38:17 [DEBUG   ] Finished updating board flags in 1.720 seconds
2019-01-18 05:38:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:38:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:39:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:39:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:39:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:39:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:39:17 [WARNING ] (13, 1, 'bot')
2019-01-18 05:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:39:17 [DEBUG   ] Finished updating board flags in 1.486 seconds
2019-01-18 05:39:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:39:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:40:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:40:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:40:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:40:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:40:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:40:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:40:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:40:18 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-01-18 05:40:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:40:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:41:05 [DEBUG   ] Got command RPT from MCS: ref #1203353
2019-01-18 05:41:05 [DEBUG   ] summary = ERROR
2019-01-18 05:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203353  13 58501 20465873 A  ERRORERROR'
2019-01-18 05:41:05 [DEBUG   ] Got command RPT from MCS: ref #1203354
2019-01-18 05:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203354  77 58501 20465874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:41:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:41:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:41:18 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:41:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:41:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:41:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:41:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:41:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:41:18 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-01-18 05:41:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 05:41:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:42:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:42:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:42:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:42:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:42:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:42:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:42:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:42:18 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-01-18 05:42:24 [DEBUG   ] Got command RPT from MCS: ref #1203370
2019-01-18 05:42:24 [DEBUG   ] summary = ERROR
2019-01-18 05:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203370  13 58501 20544097 A  ERRORERROR'
2019-01-18 05:42:24 [DEBUG   ] Got command RPT from MCS: ref #1203371
2019-01-18 05:42:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203371  77 58501 20544301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:42:24 [DEBUG   ] Got command RPT from MCS: ref #1203372
2019-01-18 05:42:24 [DEBUG   ] summary = ERROR
2019-01-18 05:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203372  13 58501 20544505 A  ERRORERROR'
2019-01-18 05:42:24 [DEBUG   ] Got command RPT from MCS: ref #1203373
2019-01-18 05:42:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203373  77 58501 20544697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:42:24 [DEBUG   ] Got command RPT from MCS: ref #1203374
2019-01-18 05:42:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203374  12 58501 20544905 A  ERRORB˜™š'
2019-01-18 05:42:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:42:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:43:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:43:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:43:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:43:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:43:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:43:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:43:18 [DEBUG   ] Finished updating board flags in 1.704 seconds
2019-01-18 05:43:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 05:43:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:44:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:44:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:44:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:44:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:44:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:44:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:44:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:44:18 [DEBUG   ] Finished updating board flags in 1.488 seconds
2019-01-18 05:44:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:44:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:45:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:45:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:45:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:45:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:45:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:45:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:45:18 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-18 05:45:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:45:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 05:46:05 [DEBUG   ] Got command RPT from MCS: ref #1203383
2019-01-18 05:46:05 [DEBUG   ] summary = ERROR
2019-01-18 05:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203383  13 58501 20765877 A  ERRORERROR'
2019-01-18 05:46:05 [DEBUG   ] Got command RPT from MCS: ref #1203384
2019-01-18 05:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203384  77 58501 20765878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:46:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:46:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:46:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:46:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:46:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:46:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:46:18 [DEBUG   ] Finished updating board flags in 1.447 seconds
2019-01-18 05:46:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:46:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 05:47:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 05:47:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:47:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:47:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:47:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:47:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:47:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:47:18 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-01-18 05:47:24 [DEBUG   ] Got command RPT from MCS: ref #1203402
2019-01-18 05:47:24 [DEBUG   ] summary = ERROR
2019-01-18 05:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203402  13 58501 20844181 A  ERRORERROR'
2019-01-18 05:47:24 [DEBUG   ] Got command RPT from MCS: ref #1203403
2019-01-18 05:47:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203403  77 58501 20844385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:47:24 [DEBUG   ] Got command RPT from MCS: ref #1203404
2019-01-18 05:47:24 [DEBUG   ] summary = ERROR
2019-01-18 05:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203404  13 58501 20844589 A  ERRORERROR'
2019-01-18 05:47:24 [DEBUG   ] Got command RPT from MCS: ref #1203406
2019-01-18 05:47:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203406  77 58501 20844781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:47:24 [DEBUG   ] Got command RPT from MCS: ref #1203407
2019-01-18 05:47:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203407  12 58501 20844985 A  ERRORB˜™š'
2019-01-18 05:47:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:47:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:48:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 05:48:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:48:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:48:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:48:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:48:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:48:18 [DEBUG   ] Finished updating board flags in 1.452 seconds
2019-01-18 05:48:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 05:48:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 05:49:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 05:49:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:49:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:49:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:49:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:49:18 [WARNING ] (13, 1, 'bot')
2019-01-18 05:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:49:18 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-18 05:49:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 05:49:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:50:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:50:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:50:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:50:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:50:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:50:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:50:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:50:19 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-18 05:50:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:50:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:51:05 [DEBUG   ] Got command RPT from MCS: ref #1203416
2019-01-18 05:51:05 [DEBUG   ] summary = ERROR
2019-01-18 05:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203416  13 58501 21065877 A  ERRORERROR'
2019-01-18 05:51:05 [DEBUG   ] Got command RPT from MCS: ref #1203417
2019-01-18 05:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203417  77 58501 21065878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:51:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 05:51:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:51:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:51:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:51:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:51:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:51:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:51:19 [DEBUG   ] Finished updating board flags in 2.229 seconds
2019-01-18 05:51:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:51:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 05:52:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 05:52:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:52:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:52:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:52:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:52:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:52:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:52:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:52:19 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-01-18 05:52:24 [DEBUG   ] Got command RPT from MCS: ref #1203437
2019-01-18 05:52:24 [DEBUG   ] summary = ERROR
2019-01-18 05:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203437  13 58501 21144265 A  ERRORERROR'
2019-01-18 05:52:24 [DEBUG   ] Got command RPT from MCS: ref #1203438
2019-01-18 05:52:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203438  77 58501 21144469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:52:24 [DEBUG   ] Got command RPT from MCS: ref #1203439
2019-01-18 05:52:24 [DEBUG   ] summary = ERROR
2019-01-18 05:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203439  13 58501 21144673 A  ERRORERROR'
2019-01-18 05:52:24 [DEBUG   ] Got command RPT from MCS: ref #1203440
2019-01-18 05:52:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203440  77 58501 21144865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:52:25 [DEBUG   ] Got command RPT from MCS: ref #1203441
2019-01-18 05:52:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203441  12 58501 21145069 A  ERRORB˜™š'
2019-01-18 05:52:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 05:52:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:53:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 05:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:53:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:53:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:53:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:53:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:53:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:53:19 [DEBUG   ] Finished updating board flags in 2.131 seconds
2019-01-18 05:53:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 05:53:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 05:54:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 05:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:54:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:54:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:54:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:54:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:54:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:54:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:54:19 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-18 05:54:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-18 05:54:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 05:55:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 05:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:55:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:55:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:55:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:55:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:55:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:55:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:55:19 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-18 05:55:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 05:55:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 05:56:05 [DEBUG   ] Got command RPT from MCS: ref #1203446
2019-01-18 05:56:05 [DEBUG   ] summary = ERROR
2019-01-18 05:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203446  13 58501 21365877 A  ERRORERROR'
2019-01-18 05:56:05 [DEBUG   ] Got command RPT from MCS: ref #1203447
2019-01-18 05:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203447  77 58501 21365878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:56:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 05:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:56:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:56:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:56:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:56:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:56:19 [DEBUG   ] Finished updating board flags in 1.831 seconds
2019-01-18 05:56:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:56:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 05:57:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 05:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:57:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:57:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:57:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:57:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:57:19 [DEBUG   ] Finished updating board flags in 1.762 seconds
2019-01-18 05:57:24 [DEBUG   ] Got command RPT from MCS: ref #1203465
2019-01-18 05:57:24 [DEBUG   ] summary = ERROR
2019-01-18 05:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203465  13 58501 21444353 A  ERRORERROR'
2019-01-18 05:57:24 [DEBUG   ] Got command RPT from MCS: ref #1203466
2019-01-18 05:57:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203466  77 58501 21444557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:57:24 [DEBUG   ] Got command RPT from MCS: ref #1203467
2019-01-18 05:57:24 [DEBUG   ] summary = ERROR
2019-01-18 05:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203467  13 58501 21444749 A  ERRORERROR'
2019-01-18 05:57:24 [DEBUG   ] Got command RPT from MCS: ref #1203469
2019-01-18 05:57:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 05:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203469  77 58501 21444953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 05:57:25 [DEBUG   ] Got command RPT from MCS: ref #1203471
2019-01-18 05:57:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 05:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203471  12 58501 21445157 A  ERRORB˜™š'
2019-01-18 05:57:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 05:57:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:58:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:58:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 05:58:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:58:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:58:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:58:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:58:19 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-18 05:58:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 05:58:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:59:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 05:59:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 05:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 05:59:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:59:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:59:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:59:19 [WARNING ] (13, 1, 'bot')
2019-01-18 05:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 05:59:19 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-18 05:59:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 05:59:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 06:00:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 06:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:00:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:00:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:00:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:00:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:00:19 [DEBUG   ] Finished updating board flags in 1.647 seconds
2019-01-18 06:00:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 06:00:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 06:01:05 [DEBUG   ] Got command RPT from MCS: ref #1203483
2019-01-18 06:01:05 [DEBUG   ] summary = ERROR
2019-01-18 06:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203483  13 58501 21665881 A  ERRORERROR'
2019-01-18 06:01:05 [DEBUG   ] Got command RPT from MCS: ref #1203484
2019-01-18 06:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203484  77 58501 21665882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:01:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 06:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 06:01:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:01:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:01:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:01:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:01:19 [DEBUG   ] Finished updating board flags in 1.537 seconds
2019-01-18 06:01:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-18 06:01:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:02:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:02:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:02:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:02:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:02:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:02:19 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-18 06:02:24 [DEBUG   ] Got command RPT from MCS: ref #1203500
2019-01-18 06:02:24 [DEBUG   ] summary = ERROR
2019-01-18 06:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203500  13 58501 21744437 A  ERRORERROR'
2019-01-18 06:02:24 [DEBUG   ] Got command RPT from MCS: ref #1203501
2019-01-18 06:02:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203501  77 58501 21744641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:02:24 [DEBUG   ] Got command RPT from MCS: ref #1203502
2019-01-18 06:02:24 [DEBUG   ] summary = ERROR
2019-01-18 06:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203502  13 58501 21744845 A  ERRORERROR'
2019-01-18 06:02:25 [DEBUG   ] Got command RPT from MCS: ref #1203503
2019-01-18 06:02:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203503  77 58501 21745037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:02:25 [DEBUG   ] Got command RPT from MCS: ref #1203504
2019-01-18 06:02:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203504  12 58501 21745241 A  ERRORB™™š'
2019-01-18 06:02:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 06:02:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 06:03:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 06:03:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:03:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:03:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:03:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:03:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:03:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:03:19 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-18 06:03:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 06:03:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 06:04:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:04:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:04:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:04:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:04:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:04:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:04:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:04:19 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-18 06:04:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 06:04:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 06:05:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:05:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:05:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:05:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:05:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:05:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:05:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:05:19 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-01-18 06:05:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:05:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 06:06:05 [DEBUG   ] Got command RPT from MCS: ref #1203509
2019-01-18 06:06:05 [DEBUG   ] summary = ERROR
2019-01-18 06:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203509  13 58501 21965873 A  ERRORERROR'
2019-01-18 06:06:05 [DEBUG   ] Got command RPT from MCS: ref #1203510
2019-01-18 06:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203510  77 58501 21965874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:06:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 06:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:06:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:06:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:06:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:06:19 [WARNING ] (13, 1, 'bot')
2019-01-18 06:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:06:19 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-18 06:06:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 06:06:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:07:11 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-18 06:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:07:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:07:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:07:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:07:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:07:20 [DEBUG   ] Finished updating board flags in 2.223 seconds
2019-01-18 06:07:24 [DEBUG   ] Got command RPT from MCS: ref #1203532
2019-01-18 06:07:24 [DEBUG   ] summary = ERROR
2019-01-18 06:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203532  13 58501 22044525 A  ERRORERROR'
2019-01-18 06:07:24 [DEBUG   ] Got command RPT from MCS: ref #1203533
2019-01-18 06:07:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203533  77 58501 22044729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:07:24 [DEBUG   ] Got command RPT from MCS: ref #1203534
2019-01-18 06:07:24 [DEBUG   ] summary = ERROR
2019-01-18 06:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203534  13 58501 22044921 A  ERRORERROR'
2019-01-18 06:07:25 [DEBUG   ] Got command RPT from MCS: ref #1203536
2019-01-18 06:07:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203536  77 58501 22045125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:07:25 [DEBUG   ] Got command RPT from MCS: ref #1203537
2019-01-18 06:07:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203537  12 58501 22045329 A  ERRORB˜™š'
2019-01-18 06:07:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-18 06:07:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 06:08:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 06:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:08:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:08:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:08:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:08:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:08:20 [DEBUG   ] Finished updating board flags in 2.164 seconds
2019-01-18 06:08:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 06:08:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:09:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:09:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:09:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:09:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:09:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:09:20 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-18 06:09:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 06:09:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 06:10:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:10:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:10:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:10:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:10:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:10:20 [DEBUG   ] Finished updating board flags in 2.029 seconds
2019-01-18 06:10:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 06:10:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 06:11:05 [DEBUG   ] Got command RPT from MCS: ref #1203546
2019-01-18 06:11:05 [DEBUG   ] summary = ERROR
2019-01-18 06:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203546  13 58501 22265881 A  ERRORERROR'
2019-01-18 06:11:05 [DEBUG   ] Got command RPT from MCS: ref #1203547
2019-01-18 06:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203547  77 58501 22265882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:11:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 06:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:11:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:11:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:11:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:11:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:11:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:11:20 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-18 06:11:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:11:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:12:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 06:12:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:12:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:12:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:12:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:12:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:12:20 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-18 06:12:24 [DEBUG   ] Got command RPT from MCS: ref #1203563
2019-01-18 06:12:24 [DEBUG   ] summary = ERROR
2019-01-18 06:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203563  13 58501 22344613 A  ERRORERROR'
2019-01-18 06:12:24 [DEBUG   ] Got command RPT from MCS: ref #1203564
2019-01-18 06:12:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203564  77 58501 22344805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:12:25 [DEBUG   ] Got command RPT from MCS: ref #1203565
2019-01-18 06:12:25 [DEBUG   ] summary = ERROR
2019-01-18 06:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203565  13 58501 22345009 A  ERRORERROR'
2019-01-18 06:12:25 [DEBUG   ] Got command RPT from MCS: ref #1203566
2019-01-18 06:12:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203566  77 58501 22345213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:12:25 [DEBUG   ] Got command RPT from MCS: ref #1203567
2019-01-18 06:12:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203567  12 58501 22345405 A  ERRORB˜™š'
2019-01-18 06:12:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 06:12:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:13:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 06:13:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:13:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:13:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:13:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:13:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:13:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:13:20 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-18 06:13:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 06:13:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:14:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 06:14:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 06:14:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:14:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:14:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:14:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:14:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:14:20 [DEBUG   ] Finished updating board flags in 1.660 seconds
2019-01-18 06:14:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:14:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 06:15:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 06:15:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:15:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:15:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:15:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:15:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:15:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:15:20 [DEBUG   ] Finished updating board flags in 1.522 seconds
2019-01-18 06:15:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 06:15:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-18 06:16:05 [DEBUG   ] Got command RPT from MCS: ref #1203576
2019-01-18 06:16:05 [DEBUG   ] summary = ERROR
2019-01-18 06:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203576  13 58501 22565881 A  ERRORERROR'
2019-01-18 06:16:05 [DEBUG   ] Got command RPT from MCS: ref #1203577
2019-01-18 06:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203577  77 58501 22565882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:16:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 06:16:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:16:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:16:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:16:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:16:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:16:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:16:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:16:20 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-01-18 06:16:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 06:16:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 06:17:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 06:17:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:17:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:17:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:17:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:17:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:17:20 [DEBUG   ] Finished updating board flags in 1.453 seconds
2019-01-18 06:17:24 [DEBUG   ] Got command RPT from MCS: ref #1203595
2019-01-18 06:17:24 [DEBUG   ] summary = ERROR
2019-01-18 06:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203595  13 58501 22644689 A  ERRORERROR'
2019-01-18 06:17:24 [DEBUG   ] Got command RPT from MCS: ref #1203596
2019-01-18 06:17:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203596  77 58501 22644893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:17:25 [DEBUG   ] Got command RPT from MCS: ref #1203597
2019-01-18 06:17:25 [DEBUG   ] summary = ERROR
2019-01-18 06:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203597  13 58501 22645097 A  ERRORERROR'
2019-01-18 06:17:25 [DEBUG   ] Got command RPT from MCS: ref #1203599
2019-01-18 06:17:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203599  77 58501 22645301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:17:25 [DEBUG   ] Got command RPT from MCS: ref #1203601
2019-01-18 06:17:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203601  12 58501 22645493 A  ERRORB™™š'
2019-01-18 06:17:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 06:17:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:18:00 [DEBUG   ] Got command RPT from MCS: ref #1203605
2019-01-18 06:18:00 [DEBUG   ] summary = ERROR
2019-01-18 06:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203605  13 58501 22680861 A  ERRORERROR'
2019-01-18 06:18:00 [DEBUG   ] Got command RPT from MCS: ref #1203606
2019-01-18 06:18:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203606  77 58501 22680862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:18:05 [DEBUG   ] Got command INI from MCS: ref #1203607
2019-01-18 06:18:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-18 06:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1203607   8 58501 22685862 ABOOTING'
2019-01-18 06:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 06:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:18:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:18:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:18:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:18:20 [WARNING ] (13, 1, 'bot')
2019-01-18 06:18:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:18:20 [DEBUG   ] Finished updating board flags in 1.063 seconds
2019-01-18 06:18:29 [INFO    ] -------------------
2019-01-18 06:18:29 [INFO    ]  LWA board status
2019-01-18 06:18:29 [INFO    ] -------------------
2019-01-18 06:18:29 [INFO    ] DP 1: 2 lwa27
2019-01-18 06:18:29 [INFO    ] DP 1: 3 lwa24
2019-01-18 06:18:29 [INFO    ] DP 1: 4 lwa23
2019-01-18 06:18:29 [INFO    ] DP 1: 5 lwa18
2019-01-18 06:18:29 [INFO    ] DP 1: 6 lwa10
2019-01-18 06:18:29 [INFO    ] DP 1: 7 lwa32
2019-01-18 06:18:29 [INFO    ] DP 1: 8 lwa11
2019-01-18 06:18:29 [INFO    ] DP 1: 9 lwa30
2019-01-18 06:18:29 [INFO    ] DP 1: 10 lwa12
2019-01-18 06:18:29 [INFO    ] DP 1: 11 lwa8
2019-01-18 06:18:29 [INFO    ] DP 1: 12 lwa13
2019-01-18 06:18:29 [INFO    ] DP 1: 13 lwa26
2019-01-18 06:18:29 [INFO    ] DP 1: 14 lwa14
2019-01-18 06:18:29 [INFO    ] DP 1: 16 lwa22
2019-01-18 06:18:29 [INFO    ] DP 1: 17 lwa20
2019-01-18 06:18:29 [INFO    ] DP 1: 18 lwa1
2019-01-18 06:18:29 [INFO    ] DP 1: 19 lwa5
2019-01-18 06:18:29 [INFO    ] DP 1: 20 lwa25
2019-01-18 06:18:29 [INFO    ] DP 1: 21 lwa35
2019-01-18 06:18:29 [INFO    ] DP 1: 22 lwa19
2019-01-18 06:18:29 [INFO    ] DP 1: 23 lwa21
2019-01-18 06:18:29 [INFO    ] DP 1: 24 lwa6
2019-01-18 06:18:29 [INFO    ] DP 1: 25 lwa7
2019-01-18 06:18:29 [INFO    ] DP 1: 26 lwa33
2019-01-18 06:18:29 [INFO    ] DP 1: 27 lwa15
2019-01-18 06:18:29 [INFO    ] DP 1: 28 lwa28
2019-01-18 06:18:29 [INFO    ] DP 2: 1 lwa16
2019-01-18 06:18:29 [INFO    ] DP 2: 15 lwa34
2019-01-18 06:18:29 [INFO    ] Total of 28 boards
2019-01-18 06:18:29 [INFO    ] Total of 260 stands
2019-01-18 06:18:29 [INFO    ] -------------------
2019-01-18 06:18:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8144
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8145
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8146
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8147
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8148
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8149
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8150
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8151
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8152
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8153
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8154
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8155
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8156
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8157
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8158
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8159
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8160
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8161
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8162
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8163
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8164
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8165
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8166
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8167
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8168
2019-01-18 06:18:36 [DEBUG   ] 2019-01-18 06:18:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8169
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8144 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8145 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8146 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8147 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8148 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8149 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8150 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8151 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8152 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8153 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8154 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8155 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8156 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8157 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8158 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8159 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8160 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8161 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8162 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8163 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8164 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8165 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8166 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8167 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8168 exited with status 0
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8169 exited with status 0
2019-01-18 06:18:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] spawn_process: at 2019-01-18 06:18:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8196
2019-01-18 06:18:49 [DEBUG   ] 2019-01-18 06:18:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8197
2019-01-18 06:18:54 [DEBUG   ] 2019-01-18 06:18:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8196 exited with status 0
2019-01-18 06:18:54 [DEBUG   ] 2019-01-18 06:18:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8197 exited with status 0
2019-01-18 06:18:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-18 06:18:54 [DEBUG   ] spawn_process: at 2019-01-18 06:18:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-18 06:18:54 [DEBUG   ] spawn_process: at 2019-01-18 06:18:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-18 06:18:54 [INFO    ] Setting Beam 1 xbars
2019-01-18 06:18:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-18 06:18:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-18 06:18:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-18 06:18:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-18 06:18:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-18 06:18:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-18 06:18:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-18 06:18:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-18 06:18:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-18 06:19:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-18 06:19:00 [INFO    ] Setting Beam 2 xbars
2019-01-18 06:19:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-18 06:19:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-18 06:19:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-18 06:19:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-18 06:19:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-18 06:19:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-18 06:19:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-18 06:19:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-18 06:19:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-18 06:19:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-18 06:19:05 [INFO    ] Setting Beam 3 xbars
2019-01-18 06:19:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-18 06:19:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-18 06:19:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-18 06:19:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-18 06:19:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-18 06:19:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-18 06:19:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-18 06:19:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-18 06:19:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-18 06:19:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-18 06:19:10 [INFO    ] Setting Beam 4 xbars
2019-01-18 06:19:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-18 06:19:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-18 06:19:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-18 06:19:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-18 06:19:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-18 06:19:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-18 06:19:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-18 06:19:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-18 06:19:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-18 06:19:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-18 06:19:16 [INFO    ] All xbars set
2019-01-18 06:19:16 [INFO    ] Setting adder chain routing for all beams
2019-01-18 06:19:21 [INFO    ] Setting beam ids
2019-01-18 06:19:31 [INFO    ] Starting beam delay calibration
2019-01-18 06:19:43 [INFO    ] Beam 1 latency is 5725
2019-01-18 06:19:43 [INFO    ] Beam 2 latency is 5745
2019-01-18 06:19:43 [INFO    ] Beam 3 latency is 5740
2019-01-18 06:19:43 [INFO    ] Beam 4 latency is 5714
2019-01-18 06:19:43 [INFO    ] Stop calibration
2019-01-18 06:19:51 [INFO    ] Beam delay calibration successful
2019-01-18 06:19:51 [INFO    ] Calibration passed
2019-01-18 06:19:51 [DEBUG   ] spawn_process: at 2019-01-18 06:19:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-18 06:19:51 [DEBUG   ] spawn_process: at 2019-01-18 06:19:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-18 06:19:51 [DEBUG   ] spawn_process: at 2019-01-18 06:19:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-18 06:19:51 [DEBUG   ] spawn_process: at 2019-01-18 06:19:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-18 06:19:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-18 06:19:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-18 06:19:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 265 ms (1547792392.268 s) with PID 9773 and time 1547792393
2019-01-18 06:19:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-18 06:19:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 355 ms (1547792392.357 s) with PID 9776 and time 1547792393
2019-01-18 06:19:53 [DEBUG   ] Finished updating ant stats in 0.891 seconds
2019-01-18 06:19:53 [INFO    ] Started antennas statistics background thread
2019-01-18 06:19:53 [INFO    ] Started board flags background thread
2019-01-18 06:19:53 [INFO    ] Started BAM background thread
2019-01-18 06:19:53 [INFO    ] Finished the INI process (ref. #1203607) in 107.616 s
2019-01-18 06:19:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:19:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:19:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:19:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:19:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:19:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-18 06:19:54 [DEBUG   ] Finished updating board flags in 1.077 seconds
2019-01-18 06:20:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:20:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:20:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:20:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:20:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:20:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:20:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:20:54 [WARNING ] (13, 1, 'bot')
2019-01-18 06:20:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-18 06:20:54 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-01-18 06:21:05 [DEBUG   ] Got command RPT from MCS: ref #1203612
2019-01-18 06:21:05 [DEBUG   ] summary = ERROR
2019-01-18 06:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203612  13 58501 22865857 A  ERRORERROR'
2019-01-18 06:21:05 [DEBUG   ] Got command RPT from MCS: ref #1203613
2019-01-18 06:21:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203613  98 58501 22865858 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:21:05 [DEBUG   ] Got command RPT from MCS: ref #1203614
2019-01-18 06:21:05 [DEBUG   ] summary = ERROR
2019-01-18 06:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203614  13 58501 22865881 A  ERRORERROR'
2019-01-18 06:21:05 [DEBUG   ] Got command RPT from MCS: ref #1203615
2019-01-18 06:21:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203615  98 58501 22865882 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:21:10 [DEBUG   ] Got command INI from MCS: ref #1203631
2019-01-18 06:21:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-18 06:21:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1203631   8 58501 22870878 ABOOTING'
2019-01-18 06:21:13 [DEBUG   ] Finished updating ant stats in 0.824 seconds
2019-01-18 06:21:31 [INFO    ] -------------------
2019-01-18 06:21:31 [INFO    ]  LWA board status
2019-01-18 06:21:31 [INFO    ] -------------------
2019-01-18 06:21:31 [INFO    ] DP 1: 2 lwa27
2019-01-18 06:21:31 [INFO    ] DP 1: 3 lwa24
2019-01-18 06:21:31 [INFO    ] DP 1: 4 lwa23
2019-01-18 06:21:31 [INFO    ] DP 1: 5 lwa18
2019-01-18 06:21:31 [INFO    ] DP 1: 6 lwa10
2019-01-18 06:21:31 [INFO    ] DP 1: 7 lwa32
2019-01-18 06:21:31 [INFO    ] DP 1: 8 lwa11
2019-01-18 06:21:31 [INFO    ] DP 1: 9 lwa30
2019-01-18 06:21:31 [INFO    ] DP 1: 10 lwa12
2019-01-18 06:21:31 [INFO    ] DP 1: 11 lwa8
2019-01-18 06:21:31 [INFO    ] DP 1: 12 lwa13
2019-01-18 06:21:31 [INFO    ] DP 1: 13 lwa26
2019-01-18 06:21:31 [INFO    ] DP 1: 14 lwa14
2019-01-18 06:21:31 [INFO    ] DP 1: 16 lwa22
2019-01-18 06:21:31 [INFO    ] DP 1: 17 lwa20
2019-01-18 06:21:31 [INFO    ] DP 1: 18 lwa1
2019-01-18 06:21:31 [INFO    ] DP 1: 19 lwa5
2019-01-18 06:21:31 [INFO    ] DP 1: 20 lwa25
2019-01-18 06:21:31 [INFO    ] DP 1: 21 lwa35
2019-01-18 06:21:31 [INFO    ] DP 1: 22 lwa19
2019-01-18 06:21:31 [INFO    ] DP 1: 23 lwa21
2019-01-18 06:21:31 [INFO    ] DP 1: 24 lwa6
2019-01-18 06:21:31 [INFO    ] DP 1: 25 lwa7
2019-01-18 06:21:31 [INFO    ] DP 1: 26 lwa33
2019-01-18 06:21:31 [INFO    ] DP 1: 27 lwa15
2019-01-18 06:21:31 [INFO    ] DP 1: 28 lwa28
2019-01-18 06:21:31 [INFO    ] DP 2: 1 lwa16
2019-01-18 06:21:31 [INFO    ] DP 2: 15 lwa34
2019-01-18 06:21:31 [INFO    ] Total of 28 boards
2019-01-18 06:21:31 [INFO    ] Total of 260 stands
2019-01-18 06:21:31 [INFO    ] -------------------
2019-01-18 06:21:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10345
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10346
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10347
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10348
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10349
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10350
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10351
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10352
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10353
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10354
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10355
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10356
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10357
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10358
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10359
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10360
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10361
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10362
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10363
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10364
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10365
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10366
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10367
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10368
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10369
2019-01-18 06:21:38 [DEBUG   ] 2019-01-18 06:21:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10370
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10345 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10346 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10347 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10348 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10349 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10350 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10351 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10352 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10353 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10354 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10355 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10356 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10357 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10358 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10359 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10360 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10361 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10362 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10363 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10364 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10365 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10366 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10367 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10368 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10369 exited with status 0
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10370 exited with status 0
2019-01-18 06:21:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] spawn_process: at 2019-01-18 06:21:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10397
2019-01-18 06:21:50 [DEBUG   ] 2019-01-18 06:21:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10398
2019-01-18 06:21:56 [DEBUG   ] 2019-01-18 06:21:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10397 exited with status 0
2019-01-18 06:21:56 [DEBUG   ] 2019-01-18 06:21:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10398 exited with status 0
2019-01-18 06:21:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-18 06:21:56 [DEBUG   ] spawn_process: at 2019-01-18 06:21:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-18 06:21:56 [DEBUG   ] spawn_process: at 2019-01-18 06:21:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-18 06:21:56 [INFO    ] Setting Beam 1 xbars
2019-01-18 06:21:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-18 06:21:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-18 06:21:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-18 06:21:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-18 06:21:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-18 06:21:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-18 06:21:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-18 06:21:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-18 06:21:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-18 06:22:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-18 06:22:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-18 06:22:01 [INFO    ] Setting Beam 2 xbars
2019-01-18 06:22:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-18 06:22:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-18 06:22:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-18 06:22:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-18 06:22:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-18 06:22:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-18 06:22:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-18 06:22:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-18 06:22:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-18 06:22:07 [INFO    ] Setting Beam 3 xbars
2019-01-18 06:22:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-18 06:22:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-18 06:22:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-18 06:22:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-18 06:22:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-18 06:22:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-18 06:22:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-18 06:22:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-18 06:22:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-18 06:22:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-18 06:22:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-18 06:22:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-18 06:22:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-18 06:22:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-18 06:22:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-18 06:22:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-18 06:22:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-18 06:22:12 [INFO    ] Setting Beam 4 xbars
2019-01-18 06:22:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-18 06:22:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-18 06:22:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-18 06:22:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-18 06:22:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-18 06:22:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-18 06:22:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-18 06:22:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-18 06:22:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-18 06:22:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-18 06:22:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-18 06:22:18 [INFO    ] All xbars set
2019-01-18 06:22:18 [INFO    ] Setting adder chain routing for all beams
2019-01-18 06:22:23 [INFO    ] Setting beam ids
2019-01-18 06:22:24 [DEBUG   ] Got command RPT from MCS: ref #1203636
2019-01-18 06:22:24 [DEBUG   ] summary = BOOTING
2019-01-18 06:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203636  15 58501 22944781 ABOOTINGBOOTING'
2019-01-18 06:22:33 [INFO    ] Starting beam delay calibration
2019-01-18 06:22:45 [INFO    ] Beam 1 latency is 5746
2019-01-18 06:22:45 [INFO    ] Beam 2 latency is 5734
2019-01-18 06:22:45 [INFO    ] Beam 3 latency is 5738
2019-01-18 06:22:45 [INFO    ] Beam 4 latency is 5744
2019-01-18 06:22:45 [INFO    ] Stop calibration
2019-01-18 06:22:53 [INFO    ] Beam delay calibration successful
2019-01-18 06:22:53 [INFO    ] Calibration passed
2019-01-18 06:22:53 [DEBUG   ] spawn_process: at 2019-01-18 06:22:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-18 06:22:53 [DEBUG   ] spawn_process: at 2019-01-18 06:22:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-18 06:22:53 [DEBUG   ] spawn_process: at 2019-01-18 06:22:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-18 06:22:53 [DEBUG   ] spawn_process: at 2019-01-18 06:22:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-18 06:22:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-18 06:22:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-18 06:22:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 278 ms (1547792574.281 s) with PID 11976 and time 1547792575
2019-01-18 06:22:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-18 06:22:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 367 ms (1547792574.369 s) with PID 11979 and time 1547792575
2019-01-18 06:22:55 [DEBUG   ] Finished updating ant stats in 0.878 seconds
2019-01-18 06:22:55 [INFO    ] Started antennas statistics background thread
2019-01-18 06:22:55 [INFO    ] Started board flags background thread
2019-01-18 06:22:55 [INFO    ] Started BAM background thread
2019-01-18 06:22:55 [INFO    ] Finished the INI process (ref. #1203631) in 104.616 s
2019-01-18 06:22:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:22:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:22:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:22:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:22:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:22:56 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-01-18 06:23:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:23:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:23:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:23:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:23:56 [DEBUG   ] Finished updating board flags in 1.036 seconds
2019-01-18 06:24:10 [DEBUG   ] Got command RPT from MCS: ref #1203637
2019-01-18 06:24:10 [DEBUG   ] summary = ERROR
2019-01-18 06:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203637  13 58501 23050869 A  ERRORERROR'
2019-01-18 06:24:10 [DEBUG   ] Got command RPT from MCS: ref #1203638
2019-01-18 06:24:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203638  77 58501 23050870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:24:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:24:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:24:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:24:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:24:56 [DEBUG   ] Finished updating board flags in 1.034 seconds
2019-01-18 06:25:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:25:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:25:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-18 06:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:25:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:25:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:25:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:25:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:25:57 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-18 06:26:05 [DEBUG   ] Got command RPT from MCS: ref #1203643
2019-01-18 06:26:05 [DEBUG   ] summary = ERROR
2019-01-18 06:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203643  13 58501 23165881 A  ERRORERROR'
2019-01-18 06:26:05 [DEBUG   ] Got command RPT from MCS: ref #1203644
2019-01-18 06:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203644  77 58501 23165882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:26:15 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-18 06:26:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 06:26:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:26:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:26:56 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-01-18 06:27:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:27:24 [DEBUG   ] Got command RPT from MCS: ref #1203662
2019-01-18 06:27:24 [DEBUG   ] summary = ERROR
2019-01-18 06:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203662  13 58501 23244857 A  ERRORERROR'
2019-01-18 06:27:25 [DEBUG   ] Got command RPT from MCS: ref #1203663
2019-01-18 06:27:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203663  77 58501 23245061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:27:25 [DEBUG   ] Got command RPT from MCS: ref #1203664
2019-01-18 06:27:25 [DEBUG   ] summary = ERROR
2019-01-18 06:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203664  13 58501 23245265 A  ERRORERROR'
2019-01-18 06:27:25 [DEBUG   ] Got command RPT from MCS: ref #1203666
2019-01-18 06:27:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203666  77 58501 23245937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:27:25 [DEBUG   ] Got command RPT from MCS: ref #1203667
2019-01-18 06:27:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203667  12 58501 23245937 A  ERRORB˜™š'
2019-01-18 06:27:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:27:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:27:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:27:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:27:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:27:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:27:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:27:57 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-18 06:28:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:28:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:28:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:28:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:28:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:28:56 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-18 06:29:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:29:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:29:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:29:56 [WARNING ] (13, 1, 'bot')
2019-01-18 06:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:29:56 [DEBUG   ] Finished updating board flags in 1.236 seconds
2019-01-18 06:30:15 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 06:30:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 06:30:56 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2019-01-18 06:30:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:30:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:30:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:30:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:30:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:30:57 [DEBUG   ] Finished updating board flags in 1.732 seconds
2019-01-18 06:31:05 [DEBUG   ] Got command RPT from MCS: ref #1203680
2019-01-18 06:31:05 [DEBUG   ] summary = ERROR
2019-01-18 06:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203680  13 58501 23465881 A  ERRORERROR'
2019-01-18 06:31:05 [DEBUG   ] Got command RPT from MCS: ref #1203681
2019-01-18 06:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203681  77 58501 23465882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:31:16 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2019-01-18 06:31:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:31:56 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2019-01-18 06:31:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:31:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:31:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:31:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:31:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:31:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:31:57 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-18 06:32:16 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2019-01-18 06:32:24 [DEBUG   ] Got command RPT from MCS: ref #1203697
2019-01-18 06:32:24 [DEBUG   ] summary = ERROR
2019-01-18 06:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203697  13 58501 23544945 A  ERRORERROR'
2019-01-18 06:32:25 [DEBUG   ] Got command RPT from MCS: ref #1203698
2019-01-18 06:32:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203698  77 58501 23545149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:32:25 [DEBUG   ] Got command RPT from MCS: ref #1203699
2019-01-18 06:32:25 [DEBUG   ] summary = ERROR
2019-01-18 06:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203699  13 58501 23545353 A  ERRORERROR'
2019-01-18 06:32:25 [DEBUG   ] Got command RPT from MCS: ref #1203700
2019-01-18 06:32:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203700  77 58501 23545545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:32:25 [DEBUG   ] Got command RPT from MCS: ref #1203701
2019-01-18 06:32:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203701  12 58501 23545749 A  ERRORB˜™š'
2019-01-18 06:32:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:32:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:32:56 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2019-01-18 06:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:32:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:32:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:32:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:32:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:32:57 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-18 06:33:16 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2019-01-18 06:33:37 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2019-01-18 06:33:56 [DEBUG   ] Finished updating ant stats in 0.632 seconds
2019-01-18 06:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:33:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:33:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:33:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:33:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:33:57 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-18 06:34:16 [DEBUG   ] Finished updating ant stats in 0.567 seconds
2019-01-18 06:34:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:34:56 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2019-01-18 06:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:34:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:34:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:34:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:34:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:34:57 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-18 06:35:16 [DEBUG   ] Finished updating ant stats in 0.370 seconds
2019-01-18 06:35:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 06:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:35:57 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2019-01-18 06:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:35:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:35:57 [DEBUG   ] Finished updating board flags in 1.264 seconds
2019-01-18 06:36:05 [DEBUG   ] Got command RPT from MCS: ref #1203706
2019-01-18 06:36:05 [DEBUG   ] summary = ERROR
2019-01-18 06:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203706  13 58501 23765885 A  ERRORERROR'
2019-01-18 06:36:05 [DEBUG   ] Got command RPT from MCS: ref #1203707
2019-01-18 06:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203707  77 58501 23765886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:36:17 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2019-01-18 06:36:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 06:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 06:36:57 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2019-01-18 06:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:36:57 [WARNING ] (13, 1, 'bot')
2019-01-18 06:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:36:57 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-01-18 06:37:17 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2019-01-18 06:37:25 [DEBUG   ] Got command RPT from MCS: ref #1203729
2019-01-18 06:37:25 [DEBUG   ] summary = ERROR
2019-01-18 06:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203729  13 58501 23845037 A  ERRORERROR'
2019-01-18 06:37:25 [DEBUG   ] Got command RPT from MCS: ref #1203730
2019-01-18 06:37:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203730  77 58501 23845245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:37:25 [DEBUG   ] Got command RPT from MCS: ref #1203731
2019-01-18 06:37:25 [DEBUG   ] summary = ERROR
2019-01-18 06:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203731  13 58501 23845437 A  ERRORERROR'
2019-01-18 06:37:25 [DEBUG   ] Got command RPT from MCS: ref #1203733
2019-01-18 06:37:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203733  77 58501 23845641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:37:25 [DEBUG   ] Got command RPT from MCS: ref #1203734
2019-01-18 06:37:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203734  12 58501 23845833 A  ERRORB˜™š'
2019-01-18 06:37:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:37:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:37:57 [DEBUG   ] Finished updating ant stats in 0.831 seconds
2019-01-18 06:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:37:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:37:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:37:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:37:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:37:58 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-18 06:38:05 [DEBUG   ] Got command DRX from MCS: ref #1203743
2019-01-18 06:38:05 [INFO    ] sending drx command to lwa34
2019-01-18 06:38:05 [DEBUG   ] run_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-01-18 06:38:05 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-18 06:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1203743   8 58501 23885014 A  ERROR'
2019-01-18 06:38:05 [DEBUG   ] Got command DRX from MCS: ref #1203744
2019-01-18 06:38:05 [INFO    ] sending drx command to lwa16
2019-01-18 06:38:05 [DEBUG   ] run_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2019-01-18 06:38:05 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-18 06:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1203744   8 58501 23885018 A  ERROR'
2019-01-18 06:38:05 [DEBUG   ] Got command DRX from MCS: ref #1203746
2019-01-18 06:38:05 [INFO    ] sending drx command to lwa16
2019-01-18 06:38:05 [DEBUG   ] run_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2019-01-18 06:38:05 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-18 06:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1203746   8 58501 23885022 A  ERROR'
2019-01-18 06:38:05 [DEBUG   ] Got command DRX from MCS: ref #1203745
2019-01-18 06:38:05 [INFO    ] sending drx command to lwa34
2019-01-18 06:38:05 [DEBUG   ] run_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-01-18 06:38:05 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-18 06:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1203745   8 58501 23885026 A  ERROR'
2019-01-18 06:38:05 [DEBUG   ] Got command BAM from MCS: ref #1203748
2019-01-18 06:38:05 [INFO    ] Finished processing BAM request
2019-01-18 06:38:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203748   8 58501 23885029 A  ERROR'
2019-01-18 06:38:05 [DEBUG   ] Got command BAM from MCS: ref #1203747
2019-01-18 06:38:05 [INFO    ] Finished processing BAM request
2019-01-18 06:38:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203747   8 58501 23885033 A  ERROR'
2019-01-18 06:38:05 [INFO    ] Finished starting DRX
2019-01-18 06:38:05 [INFO    ] Finished starting DRX
2019-01-18 06:38:05 [INFO    ] Finished starting DRX
2019-01-18 06:38:05 [INFO    ] Finished starting DRX
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:38:05 [DEBUG   ] spawn_process: at 2019-01-18 06:38:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:38:17 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2019-01-18 06:38:35 [DEBUG   ] Got command BAM from MCS: ref #1203751
2019-01-18 06:38:35 [INFO    ] Finished processing BAM request
2019-01-18 06:38:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203751   8 58501 23915029 A  ERROR'
2019-01-18 06:38:35 [DEBUG   ] Got command BAM from MCS: ref #1203752
2019-01-18 06:38:35 [INFO    ] Finished processing BAM request
2019-01-18 06:38:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203752   8 58501 23915033 A  ERROR'
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:38:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:38:35 [DEBUG   ] spawn_process: at 2019-01-18 06:38:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:38:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 06:38:57 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2019-01-18 06:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:38:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 06:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 06:38:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:38:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:38:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:38:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:38:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:38:58 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-18 06:39:05 [DEBUG   ] Got command BAM from MCS: ref #1203753
2019-01-18 06:39:05 [INFO    ] Finished processing BAM request
2019-01-18 06:39:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203753   8 58501 23945033 A  ERROR'
2019-01-18 06:39:05 [DEBUG   ] Got command BAM from MCS: ref #1203754
2019-01-18 06:39:05 [INFO    ] Finished processing BAM request
2019-01-18 06:39:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203754   8 58501 23945037 A  ERROR'
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:39:05 [DEBUG   ] spawn_process: at 2019-01-18 06:39:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:39:17 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2019-01-18 06:39:35 [DEBUG   ] Got command BAM from MCS: ref #1203760
2019-01-18 06:39:35 [INFO    ] Finished processing BAM request
2019-01-18 06:39:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203760   8 58501 23975033 A  ERROR'
2019-01-18 06:39:35 [DEBUG   ] Got command BAM from MCS: ref #1203759
2019-01-18 06:39:35 [INFO    ] Finished processing BAM request
2019-01-18 06:39:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203759   8 58501 23975037 A  ERROR'
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:39:35 [DEBUG   ] spawn_process: at 2019-01-18 06:39:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:39:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:39:57 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2019-01-18 06:39:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:39:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:39:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:39:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:39:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:39:58 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-18 06:40:04 [DEBUG   ] Got command BAM from MCS: ref #1203761
2019-01-18 06:40:04 [INFO    ] Finished processing BAM request
2019-01-18 06:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203761   8 58501 24004029 A  ERROR'
2019-01-18 06:40:04 [DEBUG   ] Got command BAM from MCS: ref #1203762
2019-01-18 06:40:04 [INFO    ] Finished processing BAM request
2019-01-18 06:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203762   8 58501 24004033 A  ERROR'
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:40:04 [DEBUG   ] spawn_process: at 2019-01-18 06:40:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:40:17 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2019-01-18 06:40:33 [DEBUG   ] Got command BAM from MCS: ref #1203763
2019-01-18 06:40:33 [INFO    ] Finished processing BAM request
2019-01-18 06:40:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:40:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203763   8 58501 24033025 A  ERROR'
2019-01-18 06:40:33 [DEBUG   ] Got command BAM from MCS: ref #1203764
2019-01-18 06:40:33 [INFO    ] Finished processing BAM request
2019-01-18 06:40:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:40:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203764   8 58501 24033029 A  ERROR'
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:40:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:40:33 [DEBUG   ] spawn_process: at 2019-01-18 06:40:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:40:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 06:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:40:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 06:40:58 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2019-01-18 06:40:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-18 06:40:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:40:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:40:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:40:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:40:58 [DEBUG   ] Finished updating board flags in 1.667 seconds
2019-01-18 06:41:02 [DEBUG   ] Got command BAM from MCS: ref #1203765
2019-01-18 06:41:02 [INFO    ] Finished processing BAM request
2019-01-18 06:41:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203765   8 58501 24062025 A  ERROR'
2019-01-18 06:41:02 [DEBUG   ] Got command BAM from MCS: ref #1203766
2019-01-18 06:41:02 [INFO    ] Finished processing BAM request
2019-01-18 06:41:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203766   8 58501 24062029 A  ERROR'
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:41:02 [DEBUG   ] spawn_process: at 2019-01-18 06:41:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:41:05 [DEBUG   ] Got command RPT from MCS: ref #1203767
2019-01-18 06:41:05 [DEBUG   ] summary = ERROR
2019-01-18 06:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203767  13 58501 24065885 A  ERRORERROR'
2019-01-18 06:41:05 [DEBUG   ] Got command RPT from MCS: ref #1203768
2019-01-18 06:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203768  77 58501 24065886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:41:18 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2019-01-18 06:41:31 [DEBUG   ] Got command BAM from MCS: ref #1203785
2019-01-18 06:41:31 [INFO    ] Finished processing BAM request
2019-01-18 06:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203785   8 58501 24091033 A  ERROR'
2019-01-18 06:41:31 [DEBUG   ] Got command BAM from MCS: ref #1203784
2019-01-18 06:41:31 [INFO    ] Finished processing BAM request
2019-01-18 06:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203784   8 58501 24091037 A  ERROR'
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:41:31 [DEBUG   ] spawn_process: at 2019-01-18 06:41:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:41:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:41:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 06:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:41:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-18 06:41:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:41:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:41:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:41:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:41:58 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-18 06:41:59 [DEBUG   ] Got command BAM from MCS: ref #1203786
2019-01-18 06:41:59 [INFO    ] Finished processing BAM request
2019-01-18 06:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203786   8 58501 24119025 A  ERROR'
2019-01-18 06:41:59 [DEBUG   ] Got command BAM from MCS: ref #1203787
2019-01-18 06:41:59 [INFO    ] Finished processing BAM request
2019-01-18 06:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203787   8 58501 24119029 A  ERROR'
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:41:59 [DEBUG   ] spawn_process: at 2019-01-18 06:41:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:42:18 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-18 06:42:25 [DEBUG   ] Got command RPT from MCS: ref #1203788
2019-01-18 06:42:25 [DEBUG   ] summary = ERROR
2019-01-18 06:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203788  13 58501 24145113 A  ERRORERROR'
2019-01-18 06:42:25 [DEBUG   ] Got command RPT from MCS: ref #1203789
2019-01-18 06:42:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203789  77 58501 24145317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:42:25 [DEBUG   ] Got command RPT from MCS: ref #1203790
2019-01-18 06:42:25 [DEBUG   ] summary = ERROR
2019-01-18 06:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203790  13 58501 24145521 A  ERRORERROR'
2019-01-18 06:42:25 [DEBUG   ] Got command RPT from MCS: ref #1203791
2019-01-18 06:42:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203791  77 58501 24145717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:42:25 [DEBUG   ] Got command RPT from MCS: ref #1203792
2019-01-18 06:42:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203792  12 58501 24145921 A  ERRORB¡ff'
2019-01-18 06:42:27 [DEBUG   ] Got command BAM from MCS: ref #1203794
2019-01-18 06:42:27 [INFO    ] Finished processing BAM request
2019-01-18 06:42:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203794   8 58501 24147029 A  ERROR'
2019-01-18 06:42:27 [DEBUG   ] Got command BAM from MCS: ref #1203793
2019-01-18 06:42:27 [INFO    ] Finished processing BAM request
2019-01-18 06:42:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203793   8 58501 24147033 A  ERROR'
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:42:27 [DEBUG   ] spawn_process: at 2019-01-18 06:42:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:42:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:42:55 [DEBUG   ] Got command BAM from MCS: ref #1203799
2019-01-18 06:42:55 [INFO    ] Finished processing BAM request
2019-01-18 06:42:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:42:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203799   8 58501 24175029 A  ERROR'
2019-01-18 06:42:55 [DEBUG   ] Got command BAM from MCS: ref #1203800
2019-01-18 06:42:55 [INFO    ] Finished processing BAM request
2019-01-18 06:42:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:42:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203800   8 58501 24175033 A  ERROR'
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:42:55 [DEBUG   ] spawn_process: at 2019-01-18 06:42:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:42:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 06:42:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 06:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:42:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 06:42:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:42:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:42:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:42:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:42:58 [DEBUG   ] Finished updating board flags in 1.682 seconds
2019-01-18 06:43:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 06:43:23 [DEBUG   ] Got command BAM from MCS: ref #1203802
2019-01-18 06:43:23 [INFO    ] Finished processing BAM request
2019-01-18 06:43:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203802   8 58501 24203029 A  ERROR'
2019-01-18 06:43:23 [DEBUG   ] Got command BAM from MCS: ref #1203801
2019-01-18 06:43:23 [INFO    ] Finished processing BAM request
2019-01-18 06:43:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203801   8 58501 24203033 A  ERROR'
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:43:23 [DEBUG   ] spawn_process: at 2019-01-18 06:43:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:43:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 06:43:51 [DEBUG   ] Got command BAM from MCS: ref #1203803
2019-01-18 06:43:51 [INFO    ] Finished processing BAM request
2019-01-18 06:43:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203803   8 58501 24231029 A  ERROR'
2019-01-18 06:43:51 [DEBUG   ] Got command BAM from MCS: ref #1203804
2019-01-18 06:43:51 [INFO    ] Finished processing BAM request
2019-01-18 06:43:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203804   8 58501 24231033 A  ERROR'
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:43:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:43:51 [DEBUG   ] spawn_process: at 2019-01-18 06:43:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:43:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-18 06:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:43:58 [DEBUG   ] Finished updating ant stats in 0.625 seconds
2019-01-18 06:43:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 06:43:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:43:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:43:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:43:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:43:58 [DEBUG   ] Finished updating board flags in 1.330 seconds
2019-01-18 06:44:18 [DEBUG   ] Got command BAM from MCS: ref #1203806
2019-01-18 06:44:18 [INFO    ] Finished processing BAM request
2019-01-18 06:44:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203806   8 58501 24258033 A  ERROR'
2019-01-18 06:44:18 [DEBUG   ] Got command BAM from MCS: ref #1203805
2019-01-18 06:44:18 [INFO    ] Finished processing BAM request
2019-01-18 06:44:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203805   8 58501 24258037 A  ERROR'
2019-01-18 06:44:18 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:44:18 [DEBUG   ] spawn_process: at 2019-01-18 06:44:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:44:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:44:45 [DEBUG   ] Got command BAM from MCS: ref #1203808
2019-01-18 06:44:45 [INFO    ] Finished processing BAM request
2019-01-18 06:44:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203808   8 58501 24285025 A  ERROR'
2019-01-18 06:44:45 [DEBUG   ] Got command BAM from MCS: ref #1203807
2019-01-18 06:44:45 [INFO    ] Finished processing BAM request
2019-01-18 06:44:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203807   8 58501 24285029 A  ERROR'
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:44:45 [DEBUG   ] spawn_process: at 2019-01-18 06:44:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:44:58 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2019-01-18 06:44:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 06:44:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:44:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:44:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:44:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:44:58 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-01-18 06:45:12 [DEBUG   ] Got command BAM from MCS: ref #1203810
2019-01-18 06:45:12 [INFO    ] Finished processing BAM request
2019-01-18 06:45:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203810   8 58501 24312025 A  ERROR'
2019-01-18 06:45:12 [DEBUG   ] Got command BAM from MCS: ref #1203809
2019-01-18 06:45:12 [INFO    ] Finished processing BAM request
2019-01-18 06:45:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203809   8 58501 24312029 A  ERROR'
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:45:12 [DEBUG   ] spawn_process: at 2019-01-18 06:45:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:45:18 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2019-01-18 06:45:39 [DEBUG   ] Got command BAM from MCS: ref #1203815
2019-01-18 06:45:39 [INFO    ] Finished processing BAM request
2019-01-18 06:45:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203815   8 58501 24339029 A  ERROR'
2019-01-18 06:45:39 [DEBUG   ] Got command BAM from MCS: ref #1203816
2019-01-18 06:45:39 [INFO    ] Finished processing BAM request
2019-01-18 06:45:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203816   8 58501 24339033 A  ERROR'
2019-01-18 06:45:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:45:39 [DEBUG   ] spawn_process: at 2019-01-18 06:45:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:45:59 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2019-01-18 06:45:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 06:45:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:45:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:45:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:45:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:45:59 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-01-18 06:46:05 [DEBUG   ] Got command BAM from MCS: ref #1203818
2019-01-18 06:46:05 [INFO    ] Finished processing BAM request
2019-01-18 06:46:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203818   8 58501 24365029 A  ERROR'
2019-01-18 06:46:05 [DEBUG   ] Got command BAM from MCS: ref #1203817
2019-01-18 06:46:05 [INFO    ] Finished processing BAM request
2019-01-18 06:46:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203817   8 58501 24365033 A  ERROR'
2019-01-18 06:46:05 [DEBUG   ] Got command RPT from MCS: ref #1203819
2019-01-18 06:46:05 [DEBUG   ] summary = ERROR
2019-01-18 06:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203819  13 58501 24365885 A  ERRORERROR'
2019-01-18 06:46:05 [DEBUG   ] Got command RPT from MCS: ref #1203820
2019-01-18 06:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203820  77 58501 24365886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:46:05 [DEBUG   ] spawn_process: at 2019-01-18 06:46:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:46:19 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2019-01-18 06:46:31 [DEBUG   ] Got command BAM from MCS: ref #1203837
2019-01-18 06:46:31 [INFO    ] Finished processing BAM request
2019-01-18 06:46:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203837   8 58501 24391029 A  ERROR'
2019-01-18 06:46:31 [DEBUG   ] Got command BAM from MCS: ref #1203836
2019-01-18 06:46:31 [INFO    ] Finished processing BAM request
2019-01-18 06:46:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203836   8 58501 24391033 A  ERROR'
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:46:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:46:31 [DEBUG   ] spawn_process: at 2019-01-18 06:46:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:46:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:46:57 [DEBUG   ] Got command BAM from MCS: ref #1203838
2019-01-18 06:46:57 [INFO    ] Finished processing BAM request
2019-01-18 06:46:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203838   8 58501 24417029 A  ERROR'
2019-01-18 06:46:57 [DEBUG   ] Got command BAM from MCS: ref #1203839
2019-01-18 06:46:57 [INFO    ] Finished processing BAM request
2019-01-18 06:46:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203839   8 58501 24417033 A  ERROR'
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:46:57 [DEBUG   ] spawn_process: at 2019-01-18 06:46:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:46:59 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2019-01-18 06:46:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 06:46:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:46:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:46:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:46:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:46:59 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-18 06:47:19 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2019-01-18 06:47:23 [DEBUG   ] Got command BAM from MCS: ref #1203843
2019-01-18 06:47:23 [INFO    ] Finished processing BAM request
2019-01-18 06:47:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203843   8 58501 24443029 A  ERROR'
2019-01-18 06:47:23 [DEBUG   ] Got command BAM from MCS: ref #1203842
2019-01-18 06:47:23 [INFO    ] Finished processing BAM request
2019-01-18 06:47:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203842   8 58501 24443033 A  ERROR'
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:47:23 [DEBUG   ] spawn_process: at 2019-01-18 06:47:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:47:25 [DEBUG   ] Got command RPT from MCS: ref #1203844
2019-01-18 06:47:25 [DEBUG   ] summary = ERROR
2019-01-18 06:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203844  13 58501 24445205 A  ERRORERROR'
2019-01-18 06:47:25 [DEBUG   ] Got command RPT from MCS: ref #1203845
2019-01-18 06:47:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203845  77 58501 24445409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:47:25 [DEBUG   ] Got command RPT from MCS: ref #1203846
2019-01-18 06:47:25 [DEBUG   ] summary = ERROR
2019-01-18 06:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203846  13 58501 24445602 A  ERRORERROR'
2019-01-18 06:47:25 [DEBUG   ] Got command RPT from MCS: ref #1203848
2019-01-18 06:47:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203848  77 58501 24445806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:47:26 [DEBUG   ] Got command RPT from MCS: ref #1203849
2019-01-18 06:47:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203849  12 58501 24446009 A  ERRORB£ff'
2019-01-18 06:47:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:47:49 [DEBUG   ] Got command BAM from MCS: ref #1203854
2019-01-18 06:47:49 [INFO    ] Finished processing BAM request
2019-01-18 06:47:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:47:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203854   8 58501 24469030 A  ERROR'
2019-01-18 06:47:49 [DEBUG   ] Got command BAM from MCS: ref #1203855
2019-01-18 06:47:49 [INFO    ] Finished processing BAM request
2019-01-18 06:47:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:47:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203855   8 58501 24469034 A  ERROR'
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:47:49 [DEBUG   ] spawn_process: at 2019-01-18 06:47:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 06:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:47:59 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2019-01-18 06:47:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-18 06:47:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:47:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:47:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:47:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:47:59 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-18 06:48:14 [DEBUG   ] Got command BAM from MCS: ref #1203857
2019-01-18 06:48:14 [INFO    ] Finished processing BAM request
2019-01-18 06:48:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203857   8 58501 24494034 A  ERROR'
2019-01-18 06:48:14 [DEBUG   ] Got command BAM from MCS: ref #1203856
2019-01-18 06:48:14 [INFO    ] Finished processing BAM request
2019-01-18 06:48:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203856   8 58501 24494038 A  ERROR'
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:48:14 [DEBUG   ] spawn_process: at 2019-01-18 06:48:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:48:19 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2019-01-18 06:48:39 [DEBUG   ] Got command BAM from MCS: ref #1203863
2019-01-18 06:48:39 [INFO    ] Finished processing BAM request
2019-01-18 06:48:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203863   8 58501 24519026 A  ERROR'
2019-01-18 06:48:39 [DEBUG   ] Got command BAM from MCS: ref #1203862
2019-01-18 06:48:39 [INFO    ] Finished processing BAM request
2019-01-18 06:48:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203862   8 58501 24519030 A  ERROR'
2019-01-18 06:48:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:48:39 [DEBUG   ] spawn_process: at 2019-01-18 06:48:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 06:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:48:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 06:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:48:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:48:58 [DEBUG   ] Finished updating board flags in 1.242 seconds
2019-01-18 06:48:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 06:49:04 [DEBUG   ] Got command BAM from MCS: ref #1203864
2019-01-18 06:49:04 [INFO    ] Finished processing BAM request
2019-01-18 06:49:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203864   8 58501 24544030 A  ERROR'
2019-01-18 06:49:04 [DEBUG   ] Got command BAM from MCS: ref #1203865
2019-01-18 06:49:04 [INFO    ] Finished processing BAM request
2019-01-18 06:49:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203865   8 58501 24544034 A  ERROR'
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:49:04 [DEBUG   ] spawn_process: at 2019-01-18 06:49:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:49:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:49:29 [DEBUG   ] Got command BAM from MCS: ref #1203867
2019-01-18 06:49:29 [INFO    ] Finished processing BAM request
2019-01-18 06:49:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203867   8 58501 24569034 A  ERROR'
2019-01-18 06:49:29 [DEBUG   ] Got command BAM from MCS: ref #1203866
2019-01-18 06:49:29 [INFO    ] Finished processing BAM request
2019-01-18 06:49:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203866   8 58501 24569038 A  ERROR'
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:49:29 [DEBUG   ] spawn_process: at 2019-01-18 06:49:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:49:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:49:54 [DEBUG   ] Got command BAM from MCS: ref #1203868
2019-01-18 06:49:54 [INFO    ] Finished processing BAM request
2019-01-18 06:49:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203868   8 58501 24594026 A  ERROR'
2019-01-18 06:49:54 [DEBUG   ] Got command BAM from MCS: ref #1203869
2019-01-18 06:49:54 [INFO    ] Finished processing BAM request
2019-01-18 06:49:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203869   8 58501 24594030 A  ERROR'
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:49:54 [DEBUG   ] spawn_process: at 2019-01-18 06:49:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 06:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-18 06:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2019-01-18 06:49:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 06:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:49:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:49:58 [DEBUG   ] Finished updating board flags in 1.228 seconds
2019-01-18 06:49:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:50:19 [DEBUG   ] Got command BAM from MCS: ref #1203871
2019-01-18 06:50:19 [INFO    ] Finished processing BAM request
2019-01-18 06:50:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203871   8 58501 24619030 A  ERROR'
2019-01-18 06:50:19 [DEBUG   ] Got command BAM from MCS: ref #1203870
2019-01-18 06:50:19 [INFO    ] Finished processing BAM request
2019-01-18 06:50:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203870   8 58501 24619034 A  ERROR'
2019-01-18 06:50:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:50:19 [DEBUG   ] spawn_process: at 2019-01-18 06:50:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:50:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:50:43 [DEBUG   ] Got command BAM from MCS: ref #1203872
2019-01-18 06:50:43 [INFO    ] Finished processing BAM request
2019-01-18 06:50:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:50:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203872   8 58501 24643030 A  ERROR'
2019-01-18 06:50:43 [DEBUG   ] Got command BAM from MCS: ref #1203873
2019-01-18 06:50:43 [INFO    ] Finished processing BAM request
2019-01-18 06:50:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:50:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203873   8 58501 24643034 A  ERROR'
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:50:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:50:43 [DEBUG   ] spawn_process: at 2019-01-18 06:50:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:50:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:50:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:50:58 [DEBUG   ] Finished updating board flags in 1.142 seconds
2019-01-18 06:50:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:51:05 [DEBUG   ] Got command RPT from MCS: ref #1203874
2019-01-18 06:51:05 [DEBUG   ] summary = ERROR
2019-01-18 06:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203874  13 58501 24665893 A  ERRORERROR'
2019-01-18 06:51:05 [DEBUG   ] Got command RPT from MCS: ref #1203875
2019-01-18 06:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203875  77 58501 24665894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:51:07 [DEBUG   ] Got command BAM from MCS: ref #1203891
2019-01-18 06:51:07 [INFO    ] Finished processing BAM request
2019-01-18 06:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203891   8 58501 24667026 A  ERROR'
2019-01-18 06:51:07 [DEBUG   ] Got command BAM from MCS: ref #1203892
2019-01-18 06:51:07 [INFO    ] Finished processing BAM request
2019-01-18 06:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203892   8 58501 24667030 A  ERROR'
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:51:07 [DEBUG   ] spawn_process: at 2019-01-18 06:51:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:51:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:51:31 [DEBUG   ] Got command BAM from MCS: ref #1203893
2019-01-18 06:51:31 [INFO    ] Finished processing BAM request
2019-01-18 06:51:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203893   8 58501 24691025 A  ERROR'
2019-01-18 06:51:31 [DEBUG   ] Got command BAM from MCS: ref #1203894
2019-01-18 06:51:31 [INFO    ] Finished processing BAM request
2019-01-18 06:51:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203894   8 58501 24691029 A  ERROR'
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:51:31 [DEBUG   ] spawn_process: at 2019-01-18 06:51:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:51:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:51:55 [DEBUG   ] Got command BAM from MCS: ref #1203899
2019-01-18 06:51:55 [INFO    ] Finished processing BAM request
2019-01-18 06:51:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203899   8 58501 24715033 A  ERROR'
2019-01-18 06:51:55 [DEBUG   ] Got command BAM from MCS: ref #1203900
2019-01-18 06:51:55 [INFO    ] Finished processing BAM request
2019-01-18 06:51:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203900   8 58501 24715037 A  ERROR'
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:51:55 [DEBUG   ] spawn_process: at 2019-01-18 06:51:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:51:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:51:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:51:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:51:58 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-18 06:51:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 06:52:19 [DEBUG   ] Got command BAM from MCS: ref #1203901
2019-01-18 06:52:19 [INFO    ] Finished processing BAM request
2019-01-18 06:52:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203901   8 58501 24739029 A  ERROR'
2019-01-18 06:52:19 [DEBUG   ] Got command BAM from MCS: ref #1203902
2019-01-18 06:52:19 [INFO    ] Finished processing BAM request
2019-01-18 06:52:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203902   8 58501 24739033 A  ERROR'
2019-01-18 06:52:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:52:19 [DEBUG   ] spawn_process: at 2019-01-18 06:52:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:52:25 [DEBUG   ] Got command RPT from MCS: ref #1203903
2019-01-18 06:52:25 [DEBUG   ] summary = ERROR
2019-01-18 06:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203903  13 58501 24745289 A  ERRORERROR'
2019-01-18 06:52:25 [DEBUG   ] Got command RPT from MCS: ref #1203904
2019-01-18 06:52:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203904  77 58501 24745493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:52:25 [DEBUG   ] Got command RPT from MCS: ref #1203905
2019-01-18 06:52:25 [DEBUG   ] summary = ERROR
2019-01-18 06:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203905  13 58501 24745697 A  ERRORERROR'
2019-01-18 06:52:25 [DEBUG   ] Got command RPT from MCS: ref #1203906
2019-01-18 06:52:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203906  77 58501 24745889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:52:26 [DEBUG   ] Got command RPT from MCS: ref #1203907
2019-01-18 06:52:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203907  12 58501 24746093 A  ERRORB¢ff'
2019-01-18 06:52:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 06:52:43 [DEBUG   ] Got command BAM from MCS: ref #1203909
2019-01-18 06:52:43 [INFO    ] Finished processing BAM request
2019-01-18 06:52:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203909   8 58501 24763025 A  ERROR'
2019-01-18 06:52:43 [DEBUG   ] Got command BAM from MCS: ref #1203908
2019-01-18 06:52:43 [INFO    ] Finished processing BAM request
2019-01-18 06:52:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203908   8 58501 24763029 A  ERROR'
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:52:43 [DEBUG   ] spawn_process: at 2019-01-18 06:52:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:52:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-18 06:52:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-18 06:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:52:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:52:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-18 06:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:52:58 [WARNING ] (13, 1, 'bot')
2019-01-18 06:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:52:58 [DEBUG   ] Finished updating board flags in 0.966 seconds
2019-01-18 06:52:59 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 06:53:06 [DEBUG   ] Got command BAM from MCS: ref #1203911
2019-01-18 06:53:06 [INFO    ] Finished processing BAM request
2019-01-18 06:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203911   8 58501 24786025 A  ERROR'
2019-01-18 06:53:06 [DEBUG   ] Got command BAM from MCS: ref #1203910
2019-01-18 06:53:06 [INFO    ] Finished processing BAM request
2019-01-18 06:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203910   8 58501 24786029 A  ERROR'
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:53:06 [DEBUG   ] spawn_process: at 2019-01-18 06:53:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:53:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 06:53:29 [DEBUG   ] Got command BAM from MCS: ref #1203913
2019-01-18 06:53:29 [INFO    ] Finished processing BAM request
2019-01-18 06:53:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203913   8 58501 24809025 A  ERROR'
2019-01-18 06:53:29 [DEBUG   ] Got command BAM from MCS: ref #1203912
2019-01-18 06:53:29 [INFO    ] Finished processing BAM request
2019-01-18 06:53:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203912   8 58501 24809029 A  ERROR'
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:53:29 [DEBUG   ] spawn_process: at 2019-01-18 06:53:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:53:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 06:53:52 [DEBUG   ] Got command BAM from MCS: ref #1203914
2019-01-18 06:53:52 [INFO    ] Finished processing BAM request
2019-01-18 06:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203914   8 58501 24832025 A  ERROR'
2019-01-18 06:53:52 [DEBUG   ] Got command BAM from MCS: ref #1203915
2019-01-18 06:53:52 [INFO    ] Finished processing BAM request
2019-01-18 06:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203915   8 58501 24832029 A  ERROR'
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:53:52 [DEBUG   ] spawn_process: at 2019-01-18 06:53:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:53:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 06:53:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:53:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:53:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:53:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:53:59 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-18 06:54:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 06:54:15 [DEBUG   ] Got command BAM from MCS: ref #1203917
2019-01-18 06:54:15 [INFO    ] Finished processing BAM request
2019-01-18 06:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203917   8 58501 24855025 A  ERROR'
2019-01-18 06:54:15 [DEBUG   ] Got command BAM from MCS: ref #1203916
2019-01-18 06:54:15 [INFO    ] Finished processing BAM request
2019-01-18 06:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203916   8 58501 24855029 A  ERROR'
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:54:15 [DEBUG   ] spawn_process: at 2019-01-18 06:54:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:54:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 06:54:38 [DEBUG   ] Got command BAM from MCS: ref #1203922
2019-01-18 06:54:38 [INFO    ] Finished processing BAM request
2019-01-18 06:54:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203922   8 58501 24878029 A  ERROR'
2019-01-18 06:54:38 [DEBUG   ] Got command BAM from MCS: ref #1203923
2019-01-18 06:54:38 [INFO    ] Finished processing BAM request
2019-01-18 06:54:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203923   8 58501 24878033 A  ERROR'
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:54:38 [DEBUG   ] spawn_process: at 2019-01-18 06:54:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:54:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 06:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 06:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 06:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 06:54:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 06:54:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:54:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:54:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:54:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:54:59 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-01-18 06:55:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 06:55:01 [DEBUG   ] Got command BAM from MCS: ref #1203925
2019-01-18 06:55:01 [INFO    ] Finished processing BAM request
2019-01-18 06:55:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203925   8 58501 24901033 A  ERROR'
2019-01-18 06:55:01 [DEBUG   ] Got command BAM from MCS: ref #1203924
2019-01-18 06:55:01 [INFO    ] Finished processing BAM request
2019-01-18 06:55:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203924   8 58501 24901037 A  ERROR'
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:55:01 [DEBUG   ] spawn_process: at 2019-01-18 06:55:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:55:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 06:55:24 [DEBUG   ] Got command BAM from MCS: ref #1203927
2019-01-18 06:55:24 [INFO    ] Finished processing BAM request
2019-01-18 06:55:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203927   8 58501 24924025 A  ERROR'
2019-01-18 06:55:24 [DEBUG   ] Got command BAM from MCS: ref #1203926
2019-01-18 06:55:24 [INFO    ] Finished processing BAM request
2019-01-18 06:55:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203926   8 58501 24924029 A  ERROR'
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:55:24 [DEBUG   ] spawn_process: at 2019-01-18 06:55:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:55:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:55:46 [DEBUG   ] Got command BAM from MCS: ref #1203928
2019-01-18 06:55:46 [INFO    ] Finished processing BAM request
2019-01-18 06:55:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:55:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203928   8 58501 24946025 A  ERROR'
2019-01-18 06:55:46 [DEBUG   ] Got command BAM from MCS: ref #1203929
2019-01-18 06:55:46 [INFO    ] Finished processing BAM request
2019-01-18 06:55:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:55:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203929   8 58501 24946029 A  ERROR'
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:55:46 [DEBUG   ] spawn_process: at 2019-01-18 06:55:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:55:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 06:55:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 06:55:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 06:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 06:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:55:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:55:59 [DEBUG   ] Finished updating board flags in 1.204 seconds
2019-01-18 06:56:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:56:05 [DEBUG   ] Got command RPT from MCS: ref #1203930
2019-01-18 06:56:05 [DEBUG   ] summary = ERROR
2019-01-18 06:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203930  13 58501 24965889 A  ERRORERROR'
2019-01-18 06:56:05 [DEBUG   ] Got command RPT from MCS: ref #1203931
2019-01-18 06:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203931  77 58501 24965890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:56:08 [DEBUG   ] Got command BAM from MCS: ref #1203948
2019-01-18 06:56:08 [INFO    ] Finished processing BAM request
2019-01-18 06:56:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203948   8 58501 24968029 A  ERROR'
2019-01-18 06:56:08 [DEBUG   ] Got command BAM from MCS: ref #1203947
2019-01-18 06:56:08 [INFO    ] Finished processing BAM request
2019-01-18 06:56:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:56:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203947   8 58501 24968033 A  ERROR'
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:56:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:56:08 [DEBUG   ] spawn_process: at 2019-01-18 06:56:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:56:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 06:56:30 [DEBUG   ] Got command BAM from MCS: ref #1203949
2019-01-18 06:56:30 [INFO    ] Finished processing BAM request
2019-01-18 06:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203949   8 58501 24990033 A  ERROR'
2019-01-18 06:56:30 [DEBUG   ] Got command BAM from MCS: ref #1203950
2019-01-18 06:56:30 [INFO    ] Finished processing BAM request
2019-01-18 06:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203950   8 58501 24990037 A  ERROR'
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:56:30 [DEBUG   ] spawn_process: at 2019-01-18 06:56:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:56:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 06:56:52 [DEBUG   ] Got command BAM from MCS: ref #1203952
2019-01-18 06:56:52 [INFO    ] Finished processing BAM request
2019-01-18 06:56:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203952   8 58501 25012025 A  ERROR'
2019-01-18 06:56:52 [DEBUG   ] Got command BAM from MCS: ref #1203951
2019-01-18 06:56:52 [INFO    ] Finished processing BAM request
2019-01-18 06:56:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203951   8 58501 25012029 A  ERROR'
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 06:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 06:56:52 [DEBUG   ] spawn_process: at 2019-01-18 06:56:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 06:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 06:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:56:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:56:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:56:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:56:59 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-01-18 06:57:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 06:57:14 [DEBUG   ] Got command BAM from MCS: ref #1203955
2019-01-18 06:57:14 [INFO    ] Finished processing BAM request
2019-01-18 06:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203955   8 58501 25034029 A  ERROR'
2019-01-18 06:57:14 [DEBUG   ] Got command BAM from MCS: ref #1203956
2019-01-18 06:57:14 [INFO    ] Finished processing BAM request
2019-01-18 06:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203956   8 58501 25034033 A  ERROR'
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:57:14 [DEBUG   ] spawn_process: at 2019-01-18 06:57:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:57:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:57:25 [DEBUG   ] Got command RPT from MCS: ref #1203957
2019-01-18 06:57:25 [DEBUG   ] summary = ERROR
2019-01-18 06:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203957  13 58501 25045381 A  ERRORERROR'
2019-01-18 06:57:25 [DEBUG   ] Got command RPT from MCS: ref #1203958
2019-01-18 06:57:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203958  77 58501 25045573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:57:25 [DEBUG   ] Got command RPT from MCS: ref #1203959
2019-01-18 06:57:25 [DEBUG   ] summary = ERROR
2019-01-18 06:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203959  13 58501 25045777 A  ERRORERROR'
2019-01-18 06:57:25 [DEBUG   ] Got command RPT from MCS: ref #1203961
2019-01-18 06:57:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 06:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203961  77 58501 25045981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 06:57:26 [DEBUG   ] Got command RPT from MCS: ref #1203962
2019-01-18 06:57:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 06:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203962  12 58501 25046173 A  ERRORB¤ff'
2019-01-18 06:57:36 [DEBUG   ] Got command BAM from MCS: ref #1203971
2019-01-18 06:57:36 [INFO    ] Finished processing BAM request
2019-01-18 06:57:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203971   8 58501 25056029 A  ERROR'
2019-01-18 06:57:36 [DEBUG   ] Got command BAM from MCS: ref #1203972
2019-01-18 06:57:36 [INFO    ] Finished processing BAM request
2019-01-18 06:57:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203972   8 58501 25056033 A  ERROR'
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:57:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:57:36 [DEBUG   ] spawn_process: at 2019-01-18 06:57:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:57:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:57:58 [DEBUG   ] Got command BAM from MCS: ref #1203973
2019-01-18 06:57:58 [INFO    ] Finished processing BAM request
2019-01-18 06:57:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:57:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203973   8 58501 25078025 A  ERROR'
2019-01-18 06:57:58 [DEBUG   ] Got command BAM from MCS: ref #1203974
2019-01-18 06:57:58 [INFO    ] Finished processing BAM request
2019-01-18 06:57:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:57:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203974   8 58501 25078029 A  ERROR'
2019-01-18 06:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 06:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:57:58 [DEBUG   ] spawn_process: at 2019-01-18 06:57:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:57:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 06:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:57:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:57:59 [DEBUG   ] Finished updating board flags in 1.164 seconds
2019-01-18 06:58:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:58:19 [DEBUG   ] Got command BAM from MCS: ref #1203975
2019-01-18 06:58:19 [INFO    ] Finished processing BAM request
2019-01-18 06:58:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203975   8 58501 25099025 A  ERROR'
2019-01-18 06:58:19 [DEBUG   ] Got command BAM from MCS: ref #1203976
2019-01-18 06:58:19 [INFO    ] Finished processing BAM request
2019-01-18 06:58:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203976   8 58501 25099029 A  ERROR'
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:58:19 [DEBUG   ] spawn_process: at 2019-01-18 06:58:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:58:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:58:40 [DEBUG   ] Got command BAM from MCS: ref #1203977
2019-01-18 06:58:40 [INFO    ] Finished processing BAM request
2019-01-18 06:58:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203977   8 58501 25120033 A  ERROR'
2019-01-18 06:58:40 [DEBUG   ] Got command BAM from MCS: ref #1203978
2019-01-18 06:58:40 [INFO    ] Finished processing BAM request
2019-01-18 06:58:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203978   8 58501 25120037 A  ERROR'
2019-01-18 06:58:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 06:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 06:58:40 [DEBUG   ] spawn_process: at 2019-01-18 06:58:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 06:58:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 06:58:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 06:58:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 06:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:58:59 [WARNING ] (13, 1, 'bot')
2019-01-18 06:58:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 06:58:59 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-01-18 06:59:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:59:01 [DEBUG   ] Got command BAM from MCS: ref #1203980
2019-01-18 06:59:01 [INFO    ] Finished processing BAM request
2019-01-18 06:59:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203980   8 58501 25141029 A  ERROR'
2019-01-18 06:59:01 [DEBUG   ] Got command BAM from MCS: ref #1203979
2019-01-18 06:59:01 [INFO    ] Finished processing BAM request
2019-01-18 06:59:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203979   8 58501 25141033 A  ERROR'
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 06:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 06:59:01 [DEBUG   ] spawn_process: at 2019-01-18 06:59:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 06:59:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 06:59:22 [DEBUG   ] Got command BAM from MCS: ref #1203981
2019-01-18 06:59:22 [INFO    ] Finished processing BAM request
2019-01-18 06:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203981   8 58501 25162033 A  ERROR'
2019-01-18 06:59:22 [DEBUG   ] Got command BAM from MCS: ref #1203982
2019-01-18 06:59:22 [INFO    ] Finished processing BAM request
2019-01-18 06:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203982   8 58501 25162037 A  ERROR'
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 06:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 06:59:22 [DEBUG   ] spawn_process: at 2019-01-18 06:59:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 06:59:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 06:59:43 [DEBUG   ] Got command BAM from MCS: ref #1203983
2019-01-18 06:59:43 [INFO    ] Finished processing BAM request
2019-01-18 06:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203983   8 58501 25183029 A  ERROR'
2019-01-18 06:59:43 [DEBUG   ] Got command BAM from MCS: ref #1203984
2019-01-18 06:59:43 [INFO    ] Finished processing BAM request
2019-01-18 06:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 06:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203984   8 58501 25183033 A  ERROR'
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 06:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 06:59:43 [DEBUG   ] spawn_process: at 2019-01-18 06:59:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 06:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 06:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 06:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:00:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 07:00:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:00:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:00:00 [DEBUG   ] Finished updating board flags in 2.175 seconds
2019-01-18 07:00:04 [DEBUG   ] Got command BAM from MCS: ref #1203985
2019-01-18 07:00:04 [INFO    ] Finished processing BAM request
2019-01-18 07:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203985   8 58501 25204029 A  ERROR'
2019-01-18 07:00:04 [DEBUG   ] Got command BAM from MCS: ref #1203986
2019-01-18 07:00:04 [INFO    ] Finished processing BAM request
2019-01-18 07:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203986   8 58501 25204033 A  ERROR'
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:00:04 [DEBUG   ] spawn_process: at 2019-01-18 07:00:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:00:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 07:00:25 [DEBUG   ] Got command BAM from MCS: ref #1203987
2019-01-18 07:00:25 [INFO    ] Finished processing BAM request
2019-01-18 07:00:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203987   8 58501 25225033 A  ERROR'
2019-01-18 07:00:25 [DEBUG   ] Got command BAM from MCS: ref #1203988
2019-01-18 07:00:25 [INFO    ] Finished processing BAM request
2019-01-18 07:00:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203988   8 58501 25225037 A  ERROR'
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:00:25 [DEBUG   ] spawn_process: at 2019-01-18 07:00:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:00:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:00:46 [DEBUG   ] Got command BAM from MCS: ref #1203993
2019-01-18 07:00:46 [INFO    ] Finished processing BAM request
2019-01-18 07:00:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:00:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203993   8 58501 25246033 A  ERROR'
2019-01-18 07:00:46 [DEBUG   ] Got command BAM from MCS: ref #1203994
2019-01-18 07:00:46 [INFO    ] Finished processing BAM request
2019-01-18 07:00:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:00:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1203994   8 58501 25246037 A  ERROR'
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:00:46 [DEBUG   ] spawn_process: at 2019-01-18 07:00:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-18 07:00:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 07:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:00:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:00:59 [DEBUG   ] Finished updating board flags in 1.280 seconds
2019-01-18 07:01:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:01:05 [DEBUG   ] Got command RPT from MCS: ref #1203995
2019-01-18 07:01:05 [DEBUG   ] summary = ERROR
2019-01-18 07:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203995  13 58501 25265889 A  ERRORERROR'
2019-01-18 07:01:05 [DEBUG   ] Got command RPT from MCS: ref #1203996
2019-01-18 07:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1203996  77 58501 25265890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:01:07 [DEBUG   ] Got command BAM from MCS: ref #1204013
2019-01-18 07:01:07 [INFO    ] Finished processing BAM request
2019-01-18 07:01:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204013   8 58501 25267033 A  ERROR'
2019-01-18 07:01:07 [DEBUG   ] Got command BAM from MCS: ref #1204012
2019-01-18 07:01:07 [INFO    ] Finished processing BAM request
2019-01-18 07:01:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204012   8 58501 25267037 A  ERROR'
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:01:07 [DEBUG   ] spawn_process: at 2019-01-18 07:01:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:01:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:01:27 [DEBUG   ] Got command BAM from MCS: ref #1204014
2019-01-18 07:01:27 [INFO    ] Finished processing BAM request
2019-01-18 07:01:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204014   8 58501 25287033 A  ERROR'
2019-01-18 07:01:27 [DEBUG   ] Got command BAM from MCS: ref #1204015
2019-01-18 07:01:27 [INFO    ] Finished processing BAM request
2019-01-18 07:01:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204015   8 58501 25287037 A  ERROR'
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:01:27 [DEBUG   ] spawn_process: at 2019-01-18 07:01:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:01:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:01:47 [DEBUG   ] Got command BAM from MCS: ref #1204016
2019-01-18 07:01:47 [INFO    ] Finished processing BAM request
2019-01-18 07:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204016   8 58501 25307025 A  ERROR'
2019-01-18 07:01:47 [DEBUG   ] Got command BAM from MCS: ref #1204017
2019-01-18 07:01:47 [INFO    ] Finished processing BAM request
2019-01-18 07:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204017   8 58501 25307029 A  ERROR'
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:01:47 [DEBUG   ] spawn_process: at 2019-01-18 07:01:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 07:01:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 07:01:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 07:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:01:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:01:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:01:59 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-01-18 07:02:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:02:07 [DEBUG   ] Got command BAM from MCS: ref #1204018
2019-01-18 07:02:07 [INFO    ] Finished processing BAM request
2019-01-18 07:02:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:02:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204018   8 58501 25327033 A  ERROR'
2019-01-18 07:02:07 [DEBUG   ] Got command BAM from MCS: ref #1204019
2019-01-18 07:02:07 [INFO    ] Finished processing BAM request
2019-01-18 07:02:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:02:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204019   8 58501 25327037 A  ERROR'
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:02:07 [DEBUG   ] spawn_process: at 2019-01-18 07:02:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:02:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:02:25 [DEBUG   ] Got command RPT from MCS: ref #1204020
2019-01-18 07:02:25 [DEBUG   ] summary = ERROR
2019-01-18 07:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204020  13 58501 25345461 A  ERRORERROR'
2019-01-18 07:02:25 [DEBUG   ] Got command RPT from MCS: ref #1204021
2019-01-18 07:02:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204021  77 58501 25345665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:02:25 [DEBUG   ] Got command RPT from MCS: ref #1204022
2019-01-18 07:02:25 [DEBUG   ] summary = ERROR
2019-01-18 07:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204022  13 58501 25345869 A  ERRORERROR'
2019-01-18 07:02:26 [DEBUG   ] Got command RPT from MCS: ref #1204025
2019-01-18 07:02:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204025  77 58501 25346061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:02:26 [DEBUG   ] Got command RPT from MCS: ref #1204026
2019-01-18 07:02:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204026  12 58501 25346265 A  ERRORB£ff'
2019-01-18 07:02:27 [DEBUG   ] Got command BAM from MCS: ref #1204024
2019-01-18 07:02:27 [INFO    ] Finished processing BAM request
2019-01-18 07:02:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204024   8 58501 25347025 A  ERROR'
2019-01-18 07:02:27 [DEBUG   ] Got command BAM from MCS: ref #1204023
2019-01-18 07:02:27 [INFO    ] Finished processing BAM request
2019-01-18 07:02:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204023   8 58501 25347029 A  ERROR'
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:02:27 [DEBUG   ] spawn_process: at 2019-01-18 07:02:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:02:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:02:47 [DEBUG   ] Got command BAM from MCS: ref #1204028
2019-01-18 07:02:47 [INFO    ] Finished processing BAM request
2019-01-18 07:02:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:02:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204028   8 58501 25367029 A  ERROR'
2019-01-18 07:02:47 [DEBUG   ] Got command BAM from MCS: ref #1204027
2019-01-18 07:02:47 [INFO    ] Finished processing BAM request
2019-01-18 07:02:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:02:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204027   8 58501 25367033 A  ERROR'
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:02:47 [DEBUG   ] spawn_process: at 2019-01-18 07:02:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:02:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:02:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:02:59 [WARNING ] (13, 1, 'bot')
2019-01-18 07:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:02:59 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-01-18 07:03:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:03:07 [DEBUG   ] Got command BAM from MCS: ref #1204030
2019-01-18 07:03:07 [INFO    ] Finished processing BAM request
2019-01-18 07:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204030   8 58501 25387025 A  ERROR'
2019-01-18 07:03:07 [DEBUG   ] Got command BAM from MCS: ref #1204029
2019-01-18 07:03:07 [INFO    ] Finished processing BAM request
2019-01-18 07:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204029   8 58501 25387029 A  ERROR'
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:03:07 [DEBUG   ] spawn_process: at 2019-01-18 07:03:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:03:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:03:27 [DEBUG   ] Got command BAM from MCS: ref #1204032
2019-01-18 07:03:27 [INFO    ] Finished processing BAM request
2019-01-18 07:03:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204032   8 58501 25407029 A  ERROR'
2019-01-18 07:03:27 [DEBUG   ] Got command BAM from MCS: ref #1204031
2019-01-18 07:03:27 [INFO    ] Finished processing BAM request
2019-01-18 07:03:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204031   8 58501 25407033 A  ERROR'
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:03:27 [DEBUG   ] spawn_process: at 2019-01-18 07:03:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:03:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:03:47 [DEBUG   ] Got command BAM from MCS: ref #1204037
2019-01-18 07:03:47 [INFO    ] Finished processing BAM request
2019-01-18 07:03:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204037   8 58501 25427033 A  ERROR'
2019-01-18 07:03:47 [DEBUG   ] Got command BAM from MCS: ref #1204038
2019-01-18 07:03:47 [INFO    ] Finished processing BAM request
2019-01-18 07:03:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204038   8 58501 25427037 A  ERROR'
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:03:47 [DEBUG   ] spawn_process: at 2019-01-18 07:03:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-18 07:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:04:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 07:04:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:04:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:04:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:04:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:04:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:04:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:04:00 [DEBUG   ] Finished updating board flags in 1.523 seconds
2019-01-18 07:04:07 [DEBUG   ] Got command BAM from MCS: ref #1204039
2019-01-18 07:04:07 [INFO    ] Finished processing BAM request
2019-01-18 07:04:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204039   8 58501 25447033 A  ERROR'
2019-01-18 07:04:07 [DEBUG   ] Got command BAM from MCS: ref #1204040
2019-01-18 07:04:07 [INFO    ] Finished processing BAM request
2019-01-18 07:04:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204040   8 58501 25447037 A  ERROR'
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:04:07 [DEBUG   ] spawn_process: at 2019-01-18 07:04:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:04:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 07:04:27 [DEBUG   ] Got command BAM from MCS: ref #1204042
2019-01-18 07:04:27 [INFO    ] Finished processing BAM request
2019-01-18 07:04:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:04:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204042   8 58501 25467033 A  ERROR'
2019-01-18 07:04:27 [DEBUG   ] Got command BAM from MCS: ref #1204041
2019-01-18 07:04:27 [INFO    ] Finished processing BAM request
2019-01-18 07:04:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:04:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204041   8 58501 25467037 A  ERROR'
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:04:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:04:27 [DEBUG   ] spawn_process: at 2019-01-18 07:04:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:04:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 07:04:46 [DEBUG   ] Got command BAM from MCS: ref #1204044
2019-01-18 07:04:46 [INFO    ] Finished processing BAM request
2019-01-18 07:04:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204044   8 58501 25486033 A  ERROR'
2019-01-18 07:04:46 [DEBUG   ] Got command BAM from MCS: ref #1204043
2019-01-18 07:04:46 [INFO    ] Finished processing BAM request
2019-01-18 07:04:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204043   8 58501 25486037 A  ERROR'
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:04:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:04:46 [DEBUG   ] spawn_process: at 2019-01-18 07:04:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:05:00 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2019-01-18 07:05:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:05:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:05:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:05:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:05:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:05:00 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-01-18 07:05:05 [DEBUG   ] Got command BAM from MCS: ref #1204045
2019-01-18 07:05:05 [INFO    ] Finished processing BAM request
2019-01-18 07:05:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204045   8 58501 25505029 A  ERROR'
2019-01-18 07:05:05 [DEBUG   ] Got command BAM from MCS: ref #1204046
2019-01-18 07:05:05 [INFO    ] Finished processing BAM request
2019-01-18 07:05:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204046   8 58501 25505033 A  ERROR'
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:05:05 [DEBUG   ] spawn_process: at 2019-01-18 07:05:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:05:20 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2019-01-18 07:05:24 [DEBUG   ] Got command BAM from MCS: ref #1204048
2019-01-18 07:05:24 [INFO    ] Finished processing BAM request
2019-01-18 07:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204048   8 58501 25524025 A  ERROR'
2019-01-18 07:05:24 [DEBUG   ] Got command BAM from MCS: ref #1204047
2019-01-18 07:05:24 [INFO    ] Finished processing BAM request
2019-01-18 07:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204047   8 58501 25524029 A  ERROR'
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:05:24 [DEBUG   ] spawn_process: at 2019-01-18 07:05:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:05:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:05:43 [DEBUG   ] Got command BAM from MCS: ref #1204050
2019-01-18 07:05:43 [INFO    ] Finished processing BAM request
2019-01-18 07:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204050   8 58501 25543033 A  ERROR'
2019-01-18 07:05:43 [DEBUG   ] Got command BAM from MCS: ref #1204049
2019-01-18 07:05:43 [INFO    ] Finished processing BAM request
2019-01-18 07:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204049   8 58501 25543037 A  ERROR'
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:05:43 [DEBUG   ] spawn_process: at 2019-01-18 07:05:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:06:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:06:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:06:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:06:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:06:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:06:00 [DEBUG   ] Finished updating board flags in 1.330 seconds
2019-01-18 07:06:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:06:02 [DEBUG   ] Got command BAM from MCS: ref #1204052
2019-01-18 07:06:02 [INFO    ] Finished processing BAM request
2019-01-18 07:06:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204052   8 58501 25562029 A  ERROR'
2019-01-18 07:06:02 [DEBUG   ] Got command BAM from MCS: ref #1204051
2019-01-18 07:06:02 [INFO    ] Finished processing BAM request
2019-01-18 07:06:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204051   8 58501 25562033 A  ERROR'
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:06:02 [DEBUG   ] spawn_process: at 2019-01-18 07:06:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:06:05 [DEBUG   ] Got command RPT from MCS: ref #1204053
2019-01-18 07:06:05 [DEBUG   ] summary = ERROR
2019-01-18 07:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204053  13 58501 25565889 A  ERRORERROR'
2019-01-18 07:06:05 [DEBUG   ] Got command RPT from MCS: ref #1204054
2019-01-18 07:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204054  77 58501 25565890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:06:21 [DEBUG   ] Got command BAM from MCS: ref #1204071
2019-01-18 07:06:21 [INFO    ] Finished processing BAM request
2019-01-18 07:06:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204071   8 58501 25581033 A  ERROR'
2019-01-18 07:06:21 [DEBUG   ] Got command BAM from MCS: ref #1204070
2019-01-18 07:06:21 [INFO    ] Finished processing BAM request
2019-01-18 07:06:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204070   8 58501 25581037 A  ERROR'
2019-01-18 07:06:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:06:21 [DEBUG   ] spawn_process: at 2019-01-18 07:06:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:06:40 [DEBUG   ] Got command BAM from MCS: ref #1204076
2019-01-18 07:06:40 [INFO    ] Finished processing BAM request
2019-01-18 07:06:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204076   8 58501 25600025 A  ERROR'
2019-01-18 07:06:40 [DEBUG   ] Got command BAM from MCS: ref #1204077
2019-01-18 07:06:40 [INFO    ] Finished processing BAM request
2019-01-18 07:06:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204077   8 58501 25600029 A  ERROR'
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:06:40 [DEBUG   ] spawn_process: at 2019-01-18 07:06:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:06:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:06:59 [DEBUG   ] Got command BAM from MCS: ref #1204079
2019-01-18 07:06:59 [INFO    ] Finished processing BAM request
2019-01-18 07:06:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204079   8 58501 25619025 A  ERROR'
2019-01-18 07:06:59 [DEBUG   ] Got command BAM from MCS: ref #1204078
2019-01-18 07:06:59 [INFO    ] Finished processing BAM request
2019-01-18 07:06:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204078   8 58501 25619029 A  ERROR'
2019-01-18 07:06:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:06:59 [DEBUG   ] spawn_process: at 2019-01-18 07:06:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:07:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:07:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:07:00 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-01-18 07:07:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:07:18 [DEBUG   ] Got command BAM from MCS: ref #1204082
2019-01-18 07:07:18 [INFO    ] Finished processing BAM request
2019-01-18 07:07:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204082   8 58501 25638029 A  ERROR'
2019-01-18 07:07:18 [DEBUG   ] Got command BAM from MCS: ref #1204083
2019-01-18 07:07:18 [INFO    ] Finished processing BAM request
2019-01-18 07:07:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204083   8 58501 25638033 A  ERROR'
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:07:18 [DEBUG   ] spawn_process: at 2019-01-18 07:07:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:07:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:07:25 [DEBUG   ] Got command RPT from MCS: ref #1204084
2019-01-18 07:07:25 [DEBUG   ] summary = ERROR
2019-01-18 07:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204084  13 58501 25645549 A  ERRORERROR'
2019-01-18 07:07:25 [DEBUG   ] Got command RPT from MCS: ref #1204085
2019-01-18 07:07:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204085  77 58501 25645753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:07:25 [DEBUG   ] Got command RPT from MCS: ref #1204086
2019-01-18 07:07:25 [DEBUG   ] summary = ERROR
2019-01-18 07:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204086  13 58501 25645945 A  ERRORERROR'
2019-01-18 07:07:26 [DEBUG   ] Got command RPT from MCS: ref #1204088
2019-01-18 07:07:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204088  77 58501 25646149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:07:26 [DEBUG   ] Got command RPT from MCS: ref #1204089
2019-01-18 07:07:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204089  12 58501 25646353 A  ERRORB¢ff'
2019-01-18 07:07:37 [DEBUG   ] Got command BAM from MCS: ref #1204094
2019-01-18 07:07:37 [INFO    ] Finished processing BAM request
2019-01-18 07:07:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204094   8 58501 25657025 A  ERROR'
2019-01-18 07:07:37 [DEBUG   ] Got command BAM from MCS: ref #1204095
2019-01-18 07:07:37 [INFO    ] Finished processing BAM request
2019-01-18 07:07:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204095   8 58501 25657029 A  ERROR'
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:07:37 [DEBUG   ] spawn_process: at 2019-01-18 07:07:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:07:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:07:56 [DEBUG   ] Got command BAM from MCS: ref #1204096
2019-01-18 07:07:56 [INFO    ] Finished processing BAM request
2019-01-18 07:07:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:07:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204096   8 58501 25676029 A  ERROR'
2019-01-18 07:07:56 [DEBUG   ] Got command BAM from MCS: ref #1204097
2019-01-18 07:07:56 [INFO    ] Finished processing BAM request
2019-01-18 07:07:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:07:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204097   8 58501 25676033 A  ERROR'
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:07:56 [DEBUG   ] spawn_process: at 2019-01-18 07:07:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-18 07:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:08:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:08:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:08:00 [DEBUG   ] Finished updating board flags in 1.204 seconds
2019-01-18 07:08:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:08:15 [DEBUG   ] Got command BAM from MCS: ref #1204098
2019-01-18 07:08:15 [INFO    ] Finished processing BAM request
2019-01-18 07:08:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204098   8 58501 25695033 A  ERROR'
2019-01-18 07:08:15 [DEBUG   ] Got command BAM from MCS: ref #1204099
2019-01-18 07:08:15 [INFO    ] Finished processing BAM request
2019-01-18 07:08:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204099   8 58501 25695037 A  ERROR'
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:08:15 [DEBUG   ] spawn_process: at 2019-01-18 07:08:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:08:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:08:33 [DEBUG   ] Got command BAM from MCS: ref #1204100
2019-01-18 07:08:33 [INFO    ] Finished processing BAM request
2019-01-18 07:08:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204100   8 58501 25713025 A  ERROR'
2019-01-18 07:08:33 [DEBUG   ] Got command BAM from MCS: ref #1204101
2019-01-18 07:08:33 [INFO    ] Finished processing BAM request
2019-01-18 07:08:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204101   8 58501 25713029 A  ERROR'
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:08:33 [DEBUG   ] spawn_process: at 2019-01-18 07:08:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:08:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:08:51 [DEBUG   ] Got command BAM from MCS: ref #1204102
2019-01-18 07:08:51 [INFO    ] Finished processing BAM request
2019-01-18 07:08:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204102   8 58501 25731029 A  ERROR'
2019-01-18 07:08:51 [DEBUG   ] Got command BAM from MCS: ref #1204103
2019-01-18 07:08:51 [INFO    ] Finished processing BAM request
2019-01-18 07:08:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204103   8 58501 25731033 A  ERROR'
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:08:51 [DEBUG   ] spawn_process: at 2019-01-18 07:08:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:08:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-18 07:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:09:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:09:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:09:00 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-01-18 07:09:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:09:09 [DEBUG   ] Got command BAM from MCS: ref #1204104
2019-01-18 07:09:09 [INFO    ] Finished processing BAM request
2019-01-18 07:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204104   8 58501 25749025 A  ERROR'
2019-01-18 07:09:09 [DEBUG   ] Got command BAM from MCS: ref #1204105
2019-01-18 07:09:09 [INFO    ] Finished processing BAM request
2019-01-18 07:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204105   8 58501 25749029 A  ERROR'
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:09:09 [DEBUG   ] spawn_process: at 2019-01-18 07:09:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:09:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:09:27 [DEBUG   ] Got command BAM from MCS: ref #1204107
2019-01-18 07:09:27 [INFO    ] Finished processing BAM request
2019-01-18 07:09:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:09:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204107   8 58501 25767029 A  ERROR'
2019-01-18 07:09:27 [DEBUG   ] Got command BAM from MCS: ref #1204106
2019-01-18 07:09:27 [INFO    ] Finished processing BAM request
2019-01-18 07:09:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:09:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204106   8 58501 25767033 A  ERROR'
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:09:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:09:27 [DEBUG   ] spawn_process: at 2019-01-18 07:09:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:09:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:09:45 [DEBUG   ] Got command BAM from MCS: ref #1204112
2019-01-18 07:09:45 [INFO    ] Finished processing BAM request
2019-01-18 07:09:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204112   8 58501 25785025 A  ERROR'
2019-01-18 07:09:45 [DEBUG   ] Got command BAM from MCS: ref #1204113
2019-01-18 07:09:45 [INFO    ] Finished processing BAM request
2019-01-18 07:09:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204113   8 58501 25785029 A  ERROR'
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:09:45 [DEBUG   ] spawn_process: at 2019-01-18 07:09:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 07:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:10:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 07:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-18 07:10:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:10:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 07:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:10:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:10:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:10:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:10:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:10:01 [DEBUG   ] Finished updating board flags in 2.355 seconds
2019-01-18 07:10:03 [DEBUG   ] Got command BAM from MCS: ref #1204115
2019-01-18 07:10:03 [INFO    ] Finished processing BAM request
2019-01-18 07:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204115   8 58501 25803033 A  ERROR'
2019-01-18 07:10:03 [DEBUG   ] Got command BAM from MCS: ref #1204114
2019-01-18 07:10:03 [INFO    ] Finished processing BAM request
2019-01-18 07:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204114   8 58501 25803037 A  ERROR'
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:10:03 [DEBUG   ] spawn_process: at 2019-01-18 07:10:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:10:21 [DEBUG   ] Got command BAM from MCS: ref #1204116
2019-01-18 07:10:21 [INFO    ] Finished processing BAM request
2019-01-18 07:10:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204116   8 58501 25821025 A  ERROR'
2019-01-18 07:10:21 [DEBUG   ] Got command BAM from MCS: ref #1204117
2019-01-18 07:10:21 [INFO    ] Finished processing BAM request
2019-01-18 07:10:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204117   8 58501 25821029 A  ERROR'
2019-01-18 07:10:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:10:21 [DEBUG   ] spawn_process: at 2019-01-18 07:10:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:10:39 [DEBUG   ] Got command BAM from MCS: ref #1204118
2019-01-18 07:10:39 [INFO    ] Finished processing BAM request
2019-01-18 07:10:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204118   8 58501 25839033 A  ERROR'
2019-01-18 07:10:39 [DEBUG   ] Got command BAM from MCS: ref #1204119
2019-01-18 07:10:39 [INFO    ] Finished processing BAM request
2019-01-18 07:10:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204119   8 58501 25839037 A  ERROR'
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:10:39 [DEBUG   ] spawn_process: at 2019-01-18 07:10:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:10:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:10:57 [DEBUG   ] Got command BAM from MCS: ref #1204121
2019-01-18 07:10:57 [INFO    ] Finished processing BAM request
2019-01-18 07:10:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204121   8 58501 25857025 A  ERROR'
2019-01-18 07:10:57 [DEBUG   ] Got command BAM from MCS: ref #1204120
2019-01-18 07:10:57 [INFO    ] Finished processing BAM request
2019-01-18 07:10:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204120   8 58501 25857029 A  ERROR'
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:10:57 [DEBUG   ] spawn_process: at 2019-01-18 07:10:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:11:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:11:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-18 07:11:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:11:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:11:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:11:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:11:01 [DEBUG   ] Finished updating board flags in 1.897 seconds
2019-01-18 07:11:05 [DEBUG   ] Got command RPT from MCS: ref #1204122
2019-01-18 07:11:05 [DEBUG   ] summary = ERROR
2019-01-18 07:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204122  13 58501 25865893 A  ERRORERROR'
2019-01-18 07:11:05 [DEBUG   ] Got command RPT from MCS: ref #1204123
2019-01-18 07:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204123  77 58501 25865894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:11:15 [DEBUG   ] Got command BAM from MCS: ref #1204140
2019-01-18 07:11:15 [INFO    ] Finished processing BAM request
2019-01-18 07:11:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204140   8 58501 25875029 A  ERROR'
2019-01-18 07:11:15 [DEBUG   ] Got command BAM from MCS: ref #1204139
2019-01-18 07:11:15 [INFO    ] Finished processing BAM request
2019-01-18 07:11:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204139   8 58501 25875033 A  ERROR'
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:11:15 [DEBUG   ] spawn_process: at 2019-01-18 07:11:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:11:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 07:11:33 [DEBUG   ] Got command BAM from MCS: ref #1204141
2019-01-18 07:11:33 [INFO    ] Finished processing BAM request
2019-01-18 07:11:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204141   8 58501 25893033 A  ERROR'
2019-01-18 07:11:33 [DEBUG   ] Got command BAM from MCS: ref #1204142
2019-01-18 07:11:33 [INFO    ] Finished processing BAM request
2019-01-18 07:11:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204142   8 58501 25893037 A  ERROR'
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:11:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:11:33 [DEBUG   ] spawn_process: at 2019-01-18 07:11:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:11:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:11:51 [DEBUG   ] Got command BAM from MCS: ref #1204144
2019-01-18 07:11:51 [INFO    ] Finished processing BAM request
2019-01-18 07:11:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204144   8 58501 25911033 A  ERROR'
2019-01-18 07:11:51 [DEBUG   ] Got command BAM from MCS: ref #1204143
2019-01-18 07:11:51 [INFO    ] Finished processing BAM request
2019-01-18 07:11:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204143   8 58501 25911037 A  ERROR'
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:11:51 [DEBUG   ] spawn_process: at 2019-01-18 07:11:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:12:01 [DEBUG   ] Finished updating ant stats in 0.826 seconds
2019-01-18 07:12:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:12:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:12:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:12:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:12:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:12:01 [DEBUG   ] Finished updating board flags in 1.942 seconds
2019-01-18 07:12:09 [DEBUG   ] Got command BAM from MCS: ref #1204145
2019-01-18 07:12:09 [INFO    ] Finished processing BAM request
2019-01-18 07:12:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204145   8 58501 25929029 A  ERROR'
2019-01-18 07:12:09 [DEBUG   ] Got command BAM from MCS: ref #1204146
2019-01-18 07:12:09 [INFO    ] Finished processing BAM request
2019-01-18 07:12:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204146   8 58501 25929033 A  ERROR'
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:12:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:12:09 [DEBUG   ] spawn_process: at 2019-01-18 07:12:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:12:21 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2019-01-18 07:12:25 [DEBUG   ] Got command RPT from MCS: ref #1204147
2019-01-18 07:12:25 [DEBUG   ] summary = ERROR
2019-01-18 07:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204147  13 58501 25945637 A  ERRORERROR'
2019-01-18 07:12:25 [DEBUG   ] Got command RPT from MCS: ref #1204148
2019-01-18 07:12:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204148  77 58501 25945841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:12:26 [DEBUG   ] Got command RPT from MCS: ref #1204151
2019-01-18 07:12:26 [DEBUG   ] summary = ERROR
2019-01-18 07:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204151  13 58501 25946033 A  ERRORERROR'
2019-01-18 07:12:26 [DEBUG   ] Got command RPT from MCS: ref #1204152
2019-01-18 07:12:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204152  77 58501 25946237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:12:26 [DEBUG   ] Got command RPT from MCS: ref #1204153
2019-01-18 07:12:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204153  12 58501 25946441 A  ERRORB£ff'
2019-01-18 07:12:27 [DEBUG   ] Got command BAM from MCS: ref #1204149
2019-01-18 07:12:27 [INFO    ] Finished processing BAM request
2019-01-18 07:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204149   8 58501 25947033 A  ERROR'
2019-01-18 07:12:27 [DEBUG   ] Got command BAM from MCS: ref #1204150
2019-01-18 07:12:27 [INFO    ] Finished processing BAM request
2019-01-18 07:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204150   8 58501 25947037 A  ERROR'
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:12:27 [DEBUG   ] spawn_process: at 2019-01-18 07:12:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:12:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:12:45 [DEBUG   ] Got command BAM from MCS: ref #1204159
2019-01-18 07:12:45 [INFO    ] Finished processing BAM request
2019-01-18 07:12:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:12:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204159   8 58501 25965025 A  ERROR'
2019-01-18 07:12:45 [DEBUG   ] Got command BAM from MCS: ref #1204158
2019-01-18 07:12:45 [INFO    ] Finished processing BAM request
2019-01-18 07:12:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:12:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204158   8 58501 25965029 A  ERROR'
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:12:45 [DEBUG   ] spawn_process: at 2019-01-18 07:12:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:13:01 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2019-01-18 07:13:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:13:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:13:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:13:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:13:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:13:01 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-18 07:13:02 [DEBUG   ] Got command BAM from MCS: ref #1204161
2019-01-18 07:13:02 [INFO    ] Finished processing BAM request
2019-01-18 07:13:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204161   8 58501 25982029 A  ERROR'
2019-01-18 07:13:02 [DEBUG   ] Got command BAM from MCS: ref #1204160
2019-01-18 07:13:02 [INFO    ] Finished processing BAM request
2019-01-18 07:13:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204160   8 58501 25982033 A  ERROR'
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:13:02 [DEBUG   ] spawn_process: at 2019-01-18 07:13:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:13:19 [DEBUG   ] Got command BAM from MCS: ref #1204162
2019-01-18 07:13:19 [INFO    ] Finished processing BAM request
2019-01-18 07:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204162   8 58501 25999025 A  ERROR'
2019-01-18 07:13:19 [DEBUG   ] Got command BAM from MCS: ref #1204163
2019-01-18 07:13:19 [INFO    ] Finished processing BAM request
2019-01-18 07:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204163   8 58501 25999029 A  ERROR'
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:13:19 [DEBUG   ] spawn_process: at 2019-01-18 07:13:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:13:21 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2019-01-18 07:13:36 [DEBUG   ] Got command BAM from MCS: ref #1204165
2019-01-18 07:13:36 [INFO    ] Finished processing BAM request
2019-01-18 07:13:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204165   8 58501 26016033 A  ERROR'
2019-01-18 07:13:36 [DEBUG   ] Got command BAM from MCS: ref #1204164
2019-01-18 07:13:36 [INFO    ] Finished processing BAM request
2019-01-18 07:13:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204164   8 58501 26016037 A  ERROR'
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:13:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:13:36 [DEBUG   ] spawn_process: at 2019-01-18 07:13:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:13:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 07:13:53 [DEBUG   ] Got command BAM from MCS: ref #1204167
2019-01-18 07:13:53 [INFO    ] Finished processing BAM request
2019-01-18 07:13:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204167   8 58501 26033033 A  ERROR'
2019-01-18 07:13:53 [DEBUG   ] Got command BAM from MCS: ref #1204166
2019-01-18 07:13:53 [INFO    ] Finished processing BAM request
2019-01-18 07:13:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204166   8 58501 26033037 A  ERROR'
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:13:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:13:53 [DEBUG   ] spawn_process: at 2019-01-18 07:13:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:14:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 07:14:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:14:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:14:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-18 07:14:01 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-18 07:14:10 [DEBUG   ] Got command BAM from MCS: ref #1204169
2019-01-18 07:14:10 [INFO    ] Finished processing BAM request
2019-01-18 07:14:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204169   8 58501 26050029 A  ERROR'
2019-01-18 07:14:10 [DEBUG   ] Got command BAM from MCS: ref #1204168
2019-01-18 07:14:10 [INFO    ] Finished processing BAM request
2019-01-18 07:14:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204168   8 58501 26050033 A  ERROR'
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:14:10 [DEBUG   ] spawn_process: at 2019-01-18 07:14:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:14:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:14:27 [DEBUG   ] Got command BAM from MCS: ref #1204170
2019-01-18 07:14:27 [INFO    ] Finished processing BAM request
2019-01-18 07:14:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204170   8 58501 26067029 A  ERROR'
2019-01-18 07:14:27 [DEBUG   ] Got command BAM from MCS: ref #1204171
2019-01-18 07:14:27 [INFO    ] Finished processing BAM request
2019-01-18 07:14:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204171   8 58501 26067033 A  ERROR'
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:14:27 [DEBUG   ] spawn_process: at 2019-01-18 07:14:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:14:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:14:44 [DEBUG   ] Got command BAM from MCS: ref #1204173
2019-01-18 07:14:44 [INFO    ] Finished processing BAM request
2019-01-18 07:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204173   8 58501 26084029 A  ERROR'
2019-01-18 07:14:44 [DEBUG   ] Got command BAM from MCS: ref #1204172
2019-01-18 07:14:44 [INFO    ] Finished processing BAM request
2019-01-18 07:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204172   8 58501 26084033 A  ERROR'
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:14:44 [DEBUG   ] spawn_process: at 2019-01-18 07:14:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:15:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:15:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:15:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:15:00 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-01-18 07:15:01 [DEBUG   ] Got command BAM from MCS: ref #1204175
2019-01-18 07:15:01 [INFO    ] Finished processing BAM request
2019-01-18 07:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204175   8 58501 26101033 A  ERROR'
2019-01-18 07:15:01 [DEBUG   ] Got command BAM from MCS: ref #1204174
2019-01-18 07:15:01 [INFO    ] Finished processing BAM request
2019-01-18 07:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204174   8 58501 26101037 A  ERROR'
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:15:01 [DEBUG   ] spawn_process: at 2019-01-18 07:15:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:15:02 [DEBUG   ] Finished updating ant stats in 1.479 seconds
2019-01-18 07:15:18 [DEBUG   ] Got command BAM from MCS: ref #1204177
2019-01-18 07:15:18 [INFO    ] Finished processing BAM request
2019-01-18 07:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204177   8 58501 26118033 A  ERROR'
2019-01-18 07:15:18 [DEBUG   ] Got command BAM from MCS: ref #1204176
2019-01-18 07:15:18 [INFO    ] Finished processing BAM request
2019-01-18 07:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204176   8 58501 26118037 A  ERROR'
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:15:18 [DEBUG   ] spawn_process: at 2019-01-18 07:15:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:15:22 [DEBUG   ] Finished updating ant stats in 1.126 seconds
2019-01-18 07:15:35 [DEBUG   ] Got command BAM from MCS: ref #1204183
2019-01-18 07:15:35 [INFO    ] Finished processing BAM request
2019-01-18 07:15:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204183   8 58501 26135033 A  ERROR'
2019-01-18 07:15:35 [DEBUG   ] Got command BAM from MCS: ref #1204182
2019-01-18 07:15:35 [INFO    ] Finished processing BAM request
2019-01-18 07:15:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204182   8 58501 26135037 A  ERROR'
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:15:35 [DEBUG   ] spawn_process: at 2019-01-18 07:15:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:15:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:15:52 [DEBUG   ] Got command BAM from MCS: ref #1204184
2019-01-18 07:15:52 [INFO    ] Finished processing BAM request
2019-01-18 07:15:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204184   8 58501 26152025 A  ERROR'
2019-01-18 07:15:52 [DEBUG   ] Got command BAM from MCS: ref #1204185
2019-01-18 07:15:52 [INFO    ] Finished processing BAM request
2019-01-18 07:15:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:15:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204185   8 58501 26152029 A  ERROR'
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:15:52 [DEBUG   ] spawn_process: at 2019-01-18 07:15:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 07:16:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:16:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 07:16:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:16:00 [WARNING ] (13, 1, 'bot')
2019-01-18 07:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:16:00 [DEBUG   ] Finished updating board flags in 0.973 seconds
2019-01-18 07:16:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:16:05 [DEBUG   ] Got command RPT from MCS: ref #1204186
2019-01-18 07:16:05 [DEBUG   ] summary = ERROR
2019-01-18 07:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204186  13 58501 26165893 A  ERRORERROR'
2019-01-18 07:16:05 [DEBUG   ] Got command RPT from MCS: ref #1204187
2019-01-18 07:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204187  77 58501 26165894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:16:09 [DEBUG   ] Got command BAM from MCS: ref #1204203
2019-01-18 07:16:09 [INFO    ] Finished processing BAM request
2019-01-18 07:16:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204203   8 58501 26169029 A  ERROR'
2019-01-18 07:16:09 [DEBUG   ] Got command BAM from MCS: ref #1204204
2019-01-18 07:16:09 [INFO    ] Finished processing BAM request
2019-01-18 07:16:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:16:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204204   8 58501 26169033 A  ERROR'
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:16:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:16:09 [DEBUG   ] spawn_process: at 2019-01-18 07:16:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:16:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:16:26 [DEBUG   ] Got command BAM from MCS: ref #1204206
2019-01-18 07:16:26 [INFO    ] Finished processing BAM request
2019-01-18 07:16:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204206   8 58501 26186033 A  ERROR'
2019-01-18 07:16:26 [DEBUG   ] Got command BAM from MCS: ref #1204205
2019-01-18 07:16:26 [INFO    ] Finished processing BAM request
2019-01-18 07:16:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204205   8 58501 26186037 A  ERROR'
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:16:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:16:26 [DEBUG   ] spawn_process: at 2019-01-18 07:16:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:16:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:16:43 [DEBUG   ] Got command BAM from MCS: ref #1204207
2019-01-18 07:16:43 [INFO    ] Finished processing BAM request
2019-01-18 07:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204207   8 58501 26203029 A  ERROR'
2019-01-18 07:16:43 [DEBUG   ] Got command BAM from MCS: ref #1204208
2019-01-18 07:16:43 [INFO    ] Finished processing BAM request
2019-01-18 07:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204208   8 58501 26203033 A  ERROR'
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:16:43 [DEBUG   ] spawn_process: at 2019-01-18 07:16:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:17:00 [DEBUG   ] Got command BAM from MCS: ref #1204209
2019-01-18 07:17:00 [INFO    ] Finished processing BAM request
2019-01-18 07:17:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204209   8 58501 26220025 A  ERROR'
2019-01-18 07:17:00 [DEBUG   ] Got command BAM from MCS: ref #1204210
2019-01-18 07:17:00 [INFO    ] Finished processing BAM request
2019-01-18 07:17:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204210   8 58501 26220029 A  ERROR'
2019-01-18 07:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:17:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:17:00 [DEBUG   ] spawn_process: at 2019-01-18 07:17:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:17:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:17:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:17:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:17:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:17:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:17:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:17:01 [DEBUG   ] Finished updating board flags in 1.504 seconds
2019-01-18 07:17:03 [DEBUG   ] Finished updating ant stats in 1.998 seconds
2019-01-18 07:17:17 [DEBUG   ] Got command BAM from MCS: ref #1204213
2019-01-18 07:17:17 [INFO    ] Finished processing BAM request
2019-01-18 07:17:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204213   8 58501 26237033 A  ERROR'
2019-01-18 07:17:17 [DEBUG   ] Got command BAM from MCS: ref #1204214
2019-01-18 07:17:17 [INFO    ] Finished processing BAM request
2019-01-18 07:17:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204214   8 58501 26237037 A  ERROR'
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:17:17 [DEBUG   ] spawn_process: at 2019-01-18 07:17:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:17:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:17:25 [DEBUG   ] Got command RPT from MCS: ref #1204215
2019-01-18 07:17:25 [DEBUG   ] summary = ERROR
2019-01-18 07:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204215  13 58501 26245717 A  ERRORERROR'
2019-01-18 07:17:25 [DEBUG   ] Got command RPT from MCS: ref #1204216
2019-01-18 07:17:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204216  77 58501 26245921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:17:26 [DEBUG   ] Got command RPT from MCS: ref #1204217
2019-01-18 07:17:26 [DEBUG   ] summary = ERROR
2019-01-18 07:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204217  13 58501 26246125 A  ERRORERROR'
2019-01-18 07:17:26 [DEBUG   ] Got command RPT from MCS: ref #1204219
2019-01-18 07:17:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204219  77 58501 26246317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:17:26 [DEBUG   ] Got command RPT from MCS: ref #1204221
2019-01-18 07:17:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204221  12 58501 26246521 A  ERRORB¢ff'
2019-01-18 07:17:34 [DEBUG   ] Got command BAM from MCS: ref #1204226
2019-01-18 07:17:34 [INFO    ] Finished processing BAM request
2019-01-18 07:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204226   8 58501 26254025 A  ERROR'
2019-01-18 07:17:34 [DEBUG   ] Got command BAM from MCS: ref #1204225
2019-01-18 07:17:34 [INFO    ] Finished processing BAM request
2019-01-18 07:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204225   8 58501 26254029 A  ERROR'
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:17:34 [DEBUG   ] spawn_process: at 2019-01-18 07:17:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:17:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:17:51 [DEBUG   ] Got command BAM from MCS: ref #1204227
2019-01-18 07:17:51 [INFO    ] Finished processing BAM request
2019-01-18 07:17:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204227   8 58501 26271029 A  ERROR'
2019-01-18 07:17:51 [DEBUG   ] Got command BAM from MCS: ref #1204228
2019-01-18 07:17:51 [INFO    ] Finished processing BAM request
2019-01-18 07:17:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:17:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204228   8 58501 26271033 A  ERROR'
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:17:51 [DEBUG   ] spawn_process: at 2019-01-18 07:17:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:18:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 07:18:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-18 07:18:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:18:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 07:18:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:18:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:18:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:18:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:18:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:18:01 [DEBUG   ] Finished updating board flags in 1.264 seconds
2019-01-18 07:18:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:18:08 [DEBUG   ] Got command BAM from MCS: ref #1204229
2019-01-18 07:18:08 [INFO    ] Finished processing BAM request
2019-01-18 07:18:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204229   8 58501 26288029 A  ERROR'
2019-01-18 07:18:08 [DEBUG   ] Got command BAM from MCS: ref #1204230
2019-01-18 07:18:08 [INFO    ] Finished processing BAM request
2019-01-18 07:18:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204230   8 58501 26288033 A  ERROR'
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:18:08 [DEBUG   ] spawn_process: at 2019-01-18 07:18:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:18:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:18:25 [DEBUG   ] Got command BAM from MCS: ref #1204232
2019-01-18 07:18:25 [INFO    ] Finished processing BAM request
2019-01-18 07:18:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204232   8 58501 26305033 A  ERROR'
2019-01-18 07:18:25 [DEBUG   ] Got command BAM from MCS: ref #1204231
2019-01-18 07:18:25 [INFO    ] Finished processing BAM request
2019-01-18 07:18:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204231   8 58501 26305037 A  ERROR'
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:18:25 [DEBUG   ] spawn_process: at 2019-01-18 07:18:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:18:41 [DEBUG   ] Got command BAM from MCS: ref #1204238
2019-01-18 07:18:41 [INFO    ] Finished processing BAM request
2019-01-18 07:18:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204238   8 58501 26321033 A  ERROR'
2019-01-18 07:18:41 [DEBUG   ] Got command BAM from MCS: ref #1204237
2019-01-18 07:18:41 [INFO    ] Finished processing BAM request
2019-01-18 07:18:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204237   8 58501 26321037 A  ERROR'
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:18:41 [DEBUG   ] spawn_process: at 2019-01-18 07:18:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:18:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:18:57 [DEBUG   ] Got command BAM from MCS: ref #1204240
2019-01-18 07:18:57 [INFO    ] Finished processing BAM request
2019-01-18 07:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204240   8 58501 26337025 A  ERROR'
2019-01-18 07:18:57 [DEBUG   ] Got command BAM from MCS: ref #1204239
2019-01-18 07:18:57 [INFO    ] Finished processing BAM request
2019-01-18 07:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204239   8 58501 26337029 A  ERROR'
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:18:57 [DEBUG   ] spawn_process: at 2019-01-18 07:18:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:19:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:19:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 07:19:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:19:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:19:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:19:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:19:01 [DEBUG   ] Finished updating board flags in 1.205 seconds
2019-01-18 07:19:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:19:13 [DEBUG   ] Got command BAM from MCS: ref #1204242
2019-01-18 07:19:13 [INFO    ] Finished processing BAM request
2019-01-18 07:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204242   8 58501 26353029 A  ERROR'
2019-01-18 07:19:13 [DEBUG   ] Got command BAM from MCS: ref #1204241
2019-01-18 07:19:13 [INFO    ] Finished processing BAM request
2019-01-18 07:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204241   8 58501 26353033 A  ERROR'
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:19:13 [DEBUG   ] spawn_process: at 2019-01-18 07:19:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:19:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:19:29 [DEBUG   ] Got command BAM from MCS: ref #1204244
2019-01-18 07:19:29 [INFO    ] Finished processing BAM request
2019-01-18 07:19:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204244   8 58501 26369037 A  ERROR'
2019-01-18 07:19:29 [DEBUG   ] Got command BAM from MCS: ref #1204243
2019-01-18 07:19:29 [INFO    ] Finished processing BAM request
2019-01-18 07:19:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204243   8 58501 26369045 A  ERROR'
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:19:29 [DEBUG   ] spawn_process: at 2019-01-18 07:19:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:19:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:19:45 [DEBUG   ] Got command BAM from MCS: ref #1204246
2019-01-18 07:19:45 [INFO    ] Finished processing BAM request
2019-01-18 07:19:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204246   8 58501 26385033 A  ERROR'
2019-01-18 07:19:45 [DEBUG   ] Got command BAM from MCS: ref #1204245
2019-01-18 07:19:45 [INFO    ] Finished processing BAM request
2019-01-18 07:19:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204245   8 58501 26385037 A  ERROR'
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:19:45 [DEBUG   ] spawn_process: at 2019-01-18 07:19:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:20:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-18 07:20:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:20:01 [DEBUG   ] Got command BAM from MCS: ref #1204247
2019-01-18 07:20:01 [INFO    ] Finished processing BAM request
2019-01-18 07:20:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204247   8 58501 26401029 A  ERROR'
2019-01-18 07:20:01 [DEBUG   ] Got command BAM from MCS: ref #1204248
2019-01-18 07:20:01 [INFO    ] Finished processing BAM request
2019-01-18 07:20:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204248   8 58501 26401033 A  ERROR'
2019-01-18 07:20:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:20:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:20:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:20:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:20:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:20:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:20:01 [DEBUG   ] Finished updating board flags in 1.291 seconds
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:20:01 [DEBUG   ] spawn_process: at 2019-01-18 07:20:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:20:02 [DEBUG   ] Finished updating ant stats in 1.025 seconds
2019-01-18 07:20:17 [DEBUG   ] Got command BAM from MCS: ref #1204250
2019-01-18 07:20:17 [INFO    ] Finished processing BAM request
2019-01-18 07:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204250   8 58501 26417025 A  ERROR'
2019-01-18 07:20:17 [DEBUG   ] Got command BAM from MCS: ref #1204249
2019-01-18 07:20:17 [INFO    ] Finished processing BAM request
2019-01-18 07:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204249   8 58501 26417029 A  ERROR'
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:20:17 [DEBUG   ] spawn_process: at 2019-01-18 07:20:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:20:22 [DEBUG   ] Finished updating ant stats in 0.779 seconds
2019-01-18 07:20:33 [DEBUG   ] Got command BAM from MCS: ref #1204252
2019-01-18 07:20:33 [INFO    ] Finished processing BAM request
2019-01-18 07:20:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204252   8 58501 26433025 A  ERROR'
2019-01-18 07:20:33 [DEBUG   ] Got command BAM from MCS: ref #1204251
2019-01-18 07:20:33 [INFO    ] Finished processing BAM request
2019-01-18 07:20:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204251   8 58501 26433029 A  ERROR'
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:20:33 [DEBUG   ] spawn_process: at 2019-01-18 07:20:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:20:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:20:49 [DEBUG   ] Got command BAM from MCS: ref #1204254
2019-01-18 07:20:49 [INFO    ] Finished processing BAM request
2019-01-18 07:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204254   8 58501 26449033 A  ERROR'
2019-01-18 07:20:49 [DEBUG   ] Got command BAM from MCS: ref #1204253
2019-01-18 07:20:49 [INFO    ] Finished processing BAM request
2019-01-18 07:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204253   8 58501 26449037 A  ERROR'
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:20:49 [DEBUG   ] spawn_process: at 2019-01-18 07:20:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:21:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:21:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:21:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:21:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:21:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:21:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:21:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:21:01 [DEBUG   ] Finished updating board flags in 1.108 seconds
2019-01-18 07:21:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:21:05 [DEBUG   ] Got command BAM from MCS: ref #1204255
2019-01-18 07:21:05 [INFO    ] Finished processing BAM request
2019-01-18 07:21:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204255   8 58501 26465033 A  ERROR'
2019-01-18 07:21:05 [DEBUG   ] Got command BAM from MCS: ref #1204256
2019-01-18 07:21:05 [INFO    ] Finished processing BAM request
2019-01-18 07:21:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204256   8 58501 26465037 A  ERROR'
2019-01-18 07:21:05 [DEBUG   ] Got command RPT from MCS: ref #1204257
2019-01-18 07:21:05 [DEBUG   ] summary = ERROR
2019-01-18 07:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204257  13 58501 26465889 A  ERRORERROR'
2019-01-18 07:21:05 [DEBUG   ] Got command RPT from MCS: ref #1204258
2019-01-18 07:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204258  77 58501 26465890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:21:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:21:05 [DEBUG   ] spawn_process: at 2019-01-18 07:21:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:21:21 [DEBUG   ] Got command BAM from MCS: ref #1204275
2019-01-18 07:21:21 [INFO    ] Finished processing BAM request
2019-01-18 07:21:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204275   8 58501 26481025 A  ERROR'
2019-01-18 07:21:21 [DEBUG   ] Got command BAM from MCS: ref #1204274
2019-01-18 07:21:21 [INFO    ] Finished processing BAM request
2019-01-18 07:21:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204274   8 58501 26481029 A  ERROR'
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:21:21 [DEBUG   ] spawn_process: at 2019-01-18 07:21:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:21:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:21:37 [DEBUG   ] Got command BAM from MCS: ref #1204281
2019-01-18 07:21:37 [INFO    ] Finished processing BAM request
2019-01-18 07:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204281   8 58501 26497033 A  ERROR'
2019-01-18 07:21:37 [DEBUG   ] Got command BAM from MCS: ref #1204280
2019-01-18 07:21:37 [INFO    ] Finished processing BAM request
2019-01-18 07:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204280   8 58501 26497037 A  ERROR'
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:21:37 [DEBUG   ] spawn_process: at 2019-01-18 07:21:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:21:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:21:53 [DEBUG   ] Got command BAM from MCS: ref #1204283
2019-01-18 07:21:53 [INFO    ] Finished processing BAM request
2019-01-18 07:21:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204283   8 58501 26513033 A  ERROR'
2019-01-18 07:21:53 [DEBUG   ] Got command BAM from MCS: ref #1204282
2019-01-18 07:21:53 [INFO    ] Finished processing BAM request
2019-01-18 07:21:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204282   8 58501 26513037 A  ERROR'
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:21:53 [DEBUG   ] spawn_process: at 2019-01-18 07:21:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:22:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-01-18 07:22:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-18 07:22:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:22:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:22:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:22:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:22:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:22:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:22:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:22:01 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-18 07:22:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:22:09 [DEBUG   ] Got command BAM from MCS: ref #1204285
2019-01-18 07:22:09 [INFO    ] Finished processing BAM request
2019-01-18 07:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204285   8 58501 26529029 A  ERROR'
2019-01-18 07:22:09 [DEBUG   ] Got command BAM from MCS: ref #1204284
2019-01-18 07:22:09 [INFO    ] Finished processing BAM request
2019-01-18 07:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204284   8 58501 26529033 A  ERROR'
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:22:09 [DEBUG   ] spawn_process: at 2019-01-18 07:22:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:22:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:22:25 [DEBUG   ] Got command BAM from MCS: ref #1204286
2019-01-18 07:22:25 [INFO    ] Finished processing BAM request
2019-01-18 07:22:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204286   8 58501 26545033 A  ERROR'
2019-01-18 07:22:25 [DEBUG   ] Got command BAM from MCS: ref #1204287
2019-01-18 07:22:25 [INFO    ] Finished processing BAM request
2019-01-18 07:22:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204287   8 58501 26545037 A  ERROR'
2019-01-18 07:22:25 [DEBUG   ] Got command RPT from MCS: ref #1204288
2019-01-18 07:22:25 [DEBUG   ] summary = ERROR
2019-01-18 07:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204288  13 58501 26545805 A  ERRORERROR'
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:22:25 [DEBUG   ] spawn_process: at 2019-01-18 07:22:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:22:26 [DEBUG   ] Got command RPT from MCS: ref #1204289
2019-01-18 07:22:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204289  77 58501 26546009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:22:26 [DEBUG   ] Got command RPT from MCS: ref #1204290
2019-01-18 07:22:26 [DEBUG   ] summary = ERROR
2019-01-18 07:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204290  13 58501 26546213 A  ERRORERROR'
2019-01-18 07:22:26 [DEBUG   ] Got command RPT from MCS: ref #1204291
2019-01-18 07:22:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204291  77 58501 26546405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:22:26 [DEBUG   ] Got command RPT from MCS: ref #1204292
2019-01-18 07:22:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204292  12 58501 26546609 A  ERRORB¢ff'
2019-01-18 07:22:41 [DEBUG   ] Got command BAM from MCS: ref #1204293
2019-01-18 07:22:41 [INFO    ] Finished processing BAM request
2019-01-18 07:22:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204293   8 58501 26561025 A  ERROR'
2019-01-18 07:22:41 [DEBUG   ] Got command BAM from MCS: ref #1204294
2019-01-18 07:22:41 [INFO    ] Finished processing BAM request
2019-01-18 07:22:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204294   8 58501 26561029 A  ERROR'
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:22:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:22:41 [DEBUG   ] spawn_process: at 2019-01-18 07:22:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:22:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:22:57 [DEBUG   ] Got command BAM from MCS: ref #1204296
2019-01-18 07:22:57 [INFO    ] Finished processing BAM request
2019-01-18 07:22:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204296   8 58501 26577033 A  ERROR'
2019-01-18 07:22:57 [DEBUG   ] Got command BAM from MCS: ref #1204295
2019-01-18 07:22:57 [INFO    ] Finished processing BAM request
2019-01-18 07:22:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:22:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204295   8 58501 26577037 A  ERROR'
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:22:57 [DEBUG   ] spawn_process: at 2019-01-18 07:22:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 07:23:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:23:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:23:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:23:01 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-18 07:23:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:23:13 [DEBUG   ] Got command BAM from MCS: ref #1204298
2019-01-18 07:23:13 [INFO    ] Finished processing BAM request
2019-01-18 07:23:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204298   8 58501 26593025 A  ERROR'
2019-01-18 07:23:13 [DEBUG   ] Got command BAM from MCS: ref #1204297
2019-01-18 07:23:13 [INFO    ] Finished processing BAM request
2019-01-18 07:23:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204297   8 58501 26593029 A  ERROR'
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:23:13 [DEBUG   ] spawn_process: at 2019-01-18 07:23:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:23:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:23:29 [DEBUG   ] Got command BAM from MCS: ref #1204299
2019-01-18 07:23:29 [INFO    ] Finished processing BAM request
2019-01-18 07:23:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204299   8 58501 26609029 A  ERROR'
2019-01-18 07:23:29 [DEBUG   ] Got command BAM from MCS: ref #1204300
2019-01-18 07:23:29 [INFO    ] Finished processing BAM request
2019-01-18 07:23:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204300   8 58501 26609037 A  ERROR'
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:23:29 [DEBUG   ] spawn_process: at 2019-01-18 07:23:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:23:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:23:45 [DEBUG   ] Got command BAM from MCS: ref #1204302
2019-01-18 07:23:45 [INFO    ] Finished processing BAM request
2019-01-18 07:23:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204302   8 58501 26625033 A  ERROR'
2019-01-18 07:23:45 [DEBUG   ] Got command BAM from MCS: ref #1204301
2019-01-18 07:23:45 [INFO    ] Finished processing BAM request
2019-01-18 07:23:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204301   8 58501 26625037 A  ERROR'
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:23:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:23:45 [DEBUG   ] spawn_process: at 2019-01-18 07:23:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:24:01 [DEBUG   ] Got command BAM from MCS: ref #1204303
2019-01-18 07:24:01 [INFO    ] Finished processing BAM request
2019-01-18 07:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204303   8 58501 26641037 A  ERROR'
2019-01-18 07:24:01 [DEBUG   ] Got command BAM from MCS: ref #1204304
2019-01-18 07:24:01 [INFO    ] Finished processing BAM request
2019-01-18 07:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204304   8 58501 26641045 A  ERROR'
2019-01-18 07:24:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:24:01 [DEBUG   ] spawn_process: at 2019-01-18 07:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:24:02 [DEBUG   ] Finished updating ant stats in 0.625 seconds
2019-01-18 07:24:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 07:24:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:24:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:24:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:24:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:24:02 [DEBUG   ] Finished updating board flags in 1.968 seconds
2019-01-18 07:24:17 [DEBUG   ] Got command BAM from MCS: ref #1204306
2019-01-18 07:24:17 [INFO    ] Finished processing BAM request
2019-01-18 07:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204306   8 58501 26657033 A  ERROR'
2019-01-18 07:24:17 [DEBUG   ] Got command BAM from MCS: ref #1204305
2019-01-18 07:24:17 [INFO    ] Finished processing BAM request
2019-01-18 07:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204305   8 58501 26657037 A  ERROR'
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:24:17 [DEBUG   ] spawn_process: at 2019-01-18 07:24:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:24:22 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2019-01-18 07:24:33 [DEBUG   ] Got command BAM from MCS: ref #1204308
2019-01-18 07:24:33 [INFO    ] Finished processing BAM request
2019-01-18 07:24:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204308   8 58501 26673029 A  ERROR'
2019-01-18 07:24:33 [DEBUG   ] Got command BAM from MCS: ref #1204307
2019-01-18 07:24:33 [INFO    ] Finished processing BAM request
2019-01-18 07:24:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204307   8 58501 26673033 A  ERROR'
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:24:33 [DEBUG   ] spawn_process: at 2019-01-18 07:24:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:24:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 07:24:49 [DEBUG   ] Got command BAM from MCS: ref #1204314
2019-01-18 07:24:49 [INFO    ] Finished processing BAM request
2019-01-18 07:24:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204314   8 58501 26689025 A  ERROR'
2019-01-18 07:24:49 [DEBUG   ] Got command BAM from MCS: ref #1204313
2019-01-18 07:24:49 [INFO    ] Finished processing BAM request
2019-01-18 07:24:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204313   8 58501 26689029 A  ERROR'
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:24:49 [DEBUG   ] spawn_process: at 2019-01-18 07:24:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:25:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:25:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:25:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:25:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:25:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:25:02 [DEBUG   ] Finished updating board flags in 1.551 seconds
2019-01-18 07:25:02 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2019-01-18 07:25:05 [DEBUG   ] Got command BAM from MCS: ref #1204316
2019-01-18 07:25:05 [INFO    ] Finished processing BAM request
2019-01-18 07:25:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204316   8 58501 26705033 A  ERROR'
2019-01-18 07:25:05 [DEBUG   ] Got command BAM from MCS: ref #1204315
2019-01-18 07:25:05 [INFO    ] Finished processing BAM request
2019-01-18 07:25:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204315   8 58501 26705037 A  ERROR'
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:25:05 [DEBUG   ] spawn_process: at 2019-01-18 07:25:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:25:21 [DEBUG   ] Got command BAM from MCS: ref #1204318
2019-01-18 07:25:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204318   8 58501 26721029 A  ERROR'
2019-01-18 07:25:21 [DEBUG   ] Got command BAM from MCS: ref #1204317
2019-01-18 07:25:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204317   8 58501 26721033 A  ERROR'
2019-01-18 07:25:21 [INFO    ] Finished processing BAM request
2019-01-18 07:25:21 [INFO    ] Finished processing BAM request
2019-01-18 07:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:25:21 [DEBUG   ] spawn_process: at 2019-01-18 07:25:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:25:21 [DEBUG   ] spawn_process: at 2019-01-18 07:25:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:25:21 [DEBUG   ] spawn_process: at 2019-01-18 07:25:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:25:21 [DEBUG   ] spawn_process: at 2019-01-18 07:25:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:25:22 [DEBUG   ] Finished updating ant stats in 0.364 seconds
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:25:22 [DEBUG   ] spawn_process: at 2019-01-18 07:25:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:25:37 [DEBUG   ] Got command BAM from MCS: ref #1204319
2019-01-18 07:25:37 [INFO    ] Finished processing BAM request
2019-01-18 07:25:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204319   8 58501 26737029 A  ERROR'
2019-01-18 07:25:37 [DEBUG   ] Got command BAM from MCS: ref #1204320
2019-01-18 07:25:37 [INFO    ] Finished processing BAM request
2019-01-18 07:25:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204320   8 58501 26737033 A  ERROR'
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:25:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:25:37 [DEBUG   ] spawn_process: at 2019-01-18 07:25:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:25:43 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 07:25:53 [DEBUG   ] Got command BAM from MCS: ref #1204322
2019-01-18 07:25:53 [INFO    ] Finished processing BAM request
2019-01-18 07:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204322   8 58501 26753033 A  ERROR'
2019-01-18 07:25:53 [DEBUG   ] Got command BAM from MCS: ref #1204321
2019-01-18 07:25:53 [INFO    ] Finished processing BAM request
2019-01-18 07:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204321   8 58501 26753037 A  ERROR'
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:25:53 [DEBUG   ] spawn_process: at 2019-01-18 07:25:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 07:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-18 07:26:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:26:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:26:01 [DEBUG   ] Finished updating board flags in 1.036 seconds
2019-01-18 07:26:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:26:05 [DEBUG   ] Got command RPT from MCS: ref #1204323
2019-01-18 07:26:05 [DEBUG   ] summary = ERROR
2019-01-18 07:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204323  13 58501 26765893 A  ERRORERROR'
2019-01-18 07:26:05 [DEBUG   ] Got command RPT from MCS: ref #1204324
2019-01-18 07:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204324  77 58501 26765894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:26:09 [DEBUG   ] Got command BAM from MCS: ref #1204341
2019-01-18 07:26:09 [INFO    ] Finished processing BAM request
2019-01-18 07:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204341   8 58501 26769033 A  ERROR'
2019-01-18 07:26:09 [DEBUG   ] Got command BAM from MCS: ref #1204340
2019-01-18 07:26:09 [INFO    ] Finished processing BAM request
2019-01-18 07:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204340   8 58501 26769041 A  ERROR'
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:26:09 [DEBUG   ] spawn_process: at 2019-01-18 07:26:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:26:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:26:24 [DEBUG   ] Got command BAM from MCS: ref #1204343
2019-01-18 07:26:24 [INFO    ] Finished processing BAM request
2019-01-18 07:26:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204343   8 58501 26784033 A  ERROR'
2019-01-18 07:26:24 [DEBUG   ] Got command BAM from MCS: ref #1204342
2019-01-18 07:26:24 [INFO    ] Finished processing BAM request
2019-01-18 07:26:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204342   8 58501 26784037 A  ERROR'
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:26:24 [DEBUG   ] spawn_process: at 2019-01-18 07:26:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:26:39 [DEBUG   ] Got command BAM from MCS: ref #1204345
2019-01-18 07:26:39 [INFO    ] Finished processing BAM request
2019-01-18 07:26:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204345   8 58501 26799029 A  ERROR'
2019-01-18 07:26:39 [DEBUG   ] Got command BAM from MCS: ref #1204344
2019-01-18 07:26:39 [INFO    ] Finished processing BAM request
2019-01-18 07:26:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204344   8 58501 26799033 A  ERROR'
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:26:39 [DEBUG   ] spawn_process: at 2019-01-18 07:26:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:26:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 07:26:54 [DEBUG   ] Got command BAM from MCS: ref #1204347
2019-01-18 07:26:54 [INFO    ] Finished processing BAM request
2019-01-18 07:26:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204347   8 58501 26814025 A  ERROR'
2019-01-18 07:26:54 [DEBUG   ] Got command BAM from MCS: ref #1204346
2019-01-18 07:26:54 [INFO    ] Finished processing BAM request
2019-01-18 07:26:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204346   8 58501 26814029 A  ERROR'
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:26:54 [DEBUG   ] spawn_process: at 2019-01-18 07:26:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:27:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:27:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:27:01 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-01-18 07:27:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:27:09 [DEBUG   ] Got command BAM from MCS: ref #1204348
2019-01-18 07:27:09 [INFO    ] Finished processing BAM request
2019-01-18 07:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204348   8 58501 26829029 A  ERROR'
2019-01-18 07:27:09 [DEBUG   ] Got command BAM from MCS: ref #1204349
2019-01-18 07:27:09 [INFO    ] Finished processing BAM request
2019-01-18 07:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204349   8 58501 26829033 A  ERROR'
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:27:09 [DEBUG   ] spawn_process: at 2019-01-18 07:27:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:27:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:27:24 [DEBUG   ] Got command BAM from MCS: ref #1204353
2019-01-18 07:27:24 [INFO    ] Finished processing BAM request
2019-01-18 07:27:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204353   8 58501 26844025 A  ERROR'
2019-01-18 07:27:24 [DEBUG   ] Got command BAM from MCS: ref #1204352
2019-01-18 07:27:24 [INFO    ] Finished processing BAM request
2019-01-18 07:27:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204352   8 58501 26844029 A  ERROR'
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:27:24 [DEBUG   ] spawn_process: at 2019-01-18 07:27:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:27:25 [DEBUG   ] Got command RPT from MCS: ref #1204354
2019-01-18 07:27:25 [DEBUG   ] summary = ERROR
2019-01-18 07:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204354  13 58501 26845889 A  ERRORERROR'
2019-01-18 07:27:26 [DEBUG   ] Got command RPT from MCS: ref #1204355
2019-01-18 07:27:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204355  77 58501 26846093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:27:26 [DEBUG   ] Got command RPT from MCS: ref #1204356
2019-01-18 07:27:26 [DEBUG   ] summary = ERROR
2019-01-18 07:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204356  13 58501 26846285 A  ERRORERROR'
2019-01-18 07:27:26 [DEBUG   ] Got command RPT from MCS: ref #1204358
2019-01-18 07:27:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204358  77 58501 26846489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:27:26 [DEBUG   ] Got command RPT from MCS: ref #1204359
2019-01-18 07:27:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204359  12 58501 26846693 A  ERRORB¢ff'
2019-01-18 07:27:39 [DEBUG   ] Got command BAM from MCS: ref #1204369
2019-01-18 07:27:39 [INFO    ] Finished processing BAM request
2019-01-18 07:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204369   8 58501 26859025 A  ERROR'
2019-01-18 07:27:39 [DEBUG   ] Got command BAM from MCS: ref #1204368
2019-01-18 07:27:39 [INFO    ] Finished processing BAM request
2019-01-18 07:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204368   8 58501 26859029 A  ERROR'
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:27:39 [DEBUG   ] spawn_process: at 2019-01-18 07:27:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:27:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:27:54 [DEBUG   ] Got command BAM from MCS: ref #1204371
2019-01-18 07:27:54 [INFO    ] Finished processing BAM request
2019-01-18 07:27:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204371   8 58501 26874033 A  ERROR'
2019-01-18 07:27:54 [DEBUG   ] Got command BAM from MCS: ref #1204370
2019-01-18 07:27:54 [INFO    ] Finished processing BAM request
2019-01-18 07:27:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:27:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204370   8 58501 26874037 A  ERROR'
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:27:54 [DEBUG   ] spawn_process: at 2019-01-18 07:27:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:28:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-18 07:28:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:28:01 [WARNING ] (13, 1, 'bot')
2019-01-18 07:28:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:28:01 [DEBUG   ] Finished updating board flags in 0.988 seconds
2019-01-18 07:28:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 07:28:09 [DEBUG   ] Got command BAM from MCS: ref #1204372
2019-01-18 07:28:09 [INFO    ] Finished processing BAM request
2019-01-18 07:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204372   8 58501 26889033 A  ERROR'
2019-01-18 07:28:09 [DEBUG   ] Got command BAM from MCS: ref #1204373
2019-01-18 07:28:09 [INFO    ] Finished processing BAM request
2019-01-18 07:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204373   8 58501 26889037 A  ERROR'
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:28:09 [DEBUG   ] spawn_process: at 2019-01-18 07:28:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:28:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:28:24 [DEBUG   ] Got command BAM from MCS: ref #1204375
2019-01-18 07:28:24 [INFO    ] Finished processing BAM request
2019-01-18 07:28:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204375   8 58501 26904033 A  ERROR'
2019-01-18 07:28:24 [DEBUG   ] Got command BAM from MCS: ref #1204374
2019-01-18 07:28:24 [INFO    ] Finished processing BAM request
2019-01-18 07:28:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204374   8 58501 26904037 A  ERROR'
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:28:24 [DEBUG   ] spawn_process: at 2019-01-18 07:28:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:28:39 [DEBUG   ] Got command BAM from MCS: ref #1204377
2019-01-18 07:28:39 [INFO    ] Finished processing BAM request
2019-01-18 07:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204377   8 58501 26919029 A  ERROR'
2019-01-18 07:28:39 [DEBUG   ] Got command BAM from MCS: ref #1204376
2019-01-18 07:28:39 [INFO    ] Finished processing BAM request
2019-01-18 07:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204376   8 58501 26919033 A  ERROR'
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:28:39 [DEBUG   ] spawn_process: at 2019-01-18 07:28:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:28:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:28:54 [DEBUG   ] Got command BAM from MCS: ref #1204379
2019-01-18 07:28:54 [INFO    ] Finished processing BAM request
2019-01-18 07:28:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204379   8 58501 26934025 A  ERROR'
2019-01-18 07:28:54 [DEBUG   ] Got command BAM from MCS: ref #1204378
2019-01-18 07:28:54 [INFO    ] Finished processing BAM request
2019-01-18 07:28:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204378   8 58501 26934029 A  ERROR'
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:28:54 [DEBUG   ] spawn_process: at 2019-01-18 07:28:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:29:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:29:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:29:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:29:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:29:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:29:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:29:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:29:02 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-18 07:29:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:29:09 [DEBUG   ] Got command BAM from MCS: ref #1204380
2019-01-18 07:29:09 [INFO    ] Finished processing BAM request
2019-01-18 07:29:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204380   8 58501 26949029 A  ERROR'
2019-01-18 07:29:09 [DEBUG   ] Got command BAM from MCS: ref #1204381
2019-01-18 07:29:09 [INFO    ] Finished processing BAM request
2019-01-18 07:29:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204381   8 58501 26949033 A  ERROR'
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:29:09 [DEBUG   ] spawn_process: at 2019-01-18 07:29:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:29:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 07:29:24 [DEBUG   ] Got command BAM from MCS: ref #1204382
2019-01-18 07:29:24 [INFO    ] Finished processing BAM request
2019-01-18 07:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204382   8 58501 26964025 A  ERROR'
2019-01-18 07:29:24 [DEBUG   ] Got command BAM from MCS: ref #1204383
2019-01-18 07:29:24 [INFO    ] Finished processing BAM request
2019-01-18 07:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204383   8 58501 26964029 A  ERROR'
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:29:24 [DEBUG   ] spawn_process: at 2019-01-18 07:29:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:29:39 [DEBUG   ] Got command BAM from MCS: ref #1204385
2019-01-18 07:29:39 [INFO    ] Finished processing BAM request
2019-01-18 07:29:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204385   8 58501 26979033 A  ERROR'
2019-01-18 07:29:39 [DEBUG   ] Got command BAM from MCS: ref #1204384
2019-01-18 07:29:39 [INFO    ] Finished processing BAM request
2019-01-18 07:29:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204384   8 58501 26979037 A  ERROR'
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:29:39 [DEBUG   ] spawn_process: at 2019-01-18 07:29:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:29:43 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 07:29:54 [DEBUG   ] Got command BAM from MCS: ref #1204387
2019-01-18 07:29:54 [INFO    ] Finished processing BAM request
2019-01-18 07:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204387   8 58501 26994029 A  ERROR'
2019-01-18 07:29:54 [DEBUG   ] Got command BAM from MCS: ref #1204386
2019-01-18 07:29:54 [INFO    ] Finished processing BAM request
2019-01-18 07:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204386   8 58501 26994033 A  ERROR'
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:29:54 [DEBUG   ] spawn_process: at 2019-01-18 07:29:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 07:30:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:30:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:30:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:30:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:30:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:30:02 [DEBUG   ] Finished updating board flags in 1.240 seconds
2019-01-18 07:30:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 07:30:09 [DEBUG   ] Got command BAM from MCS: ref #1204389
2019-01-18 07:30:09 [INFO    ] Finished processing BAM request
2019-01-18 07:30:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204389   8 58501 27009033 A  ERROR'
2019-01-18 07:30:09 [DEBUG   ] Got command BAM from MCS: ref #1204388
2019-01-18 07:30:09 [INFO    ] Finished processing BAM request
2019-01-18 07:30:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204388   8 58501 27009041 A  ERROR'
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:30:09 [DEBUG   ] spawn_process: at 2019-01-18 07:30:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:30:24 [DEBUG   ] Got command BAM from MCS: ref #1204391
2019-01-18 07:30:24 [INFO    ] Finished processing BAM request
2019-01-18 07:30:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204391   8 58501 27024033 A  ERROR'
2019-01-18 07:30:24 [DEBUG   ] Got command BAM from MCS: ref #1204390
2019-01-18 07:30:24 [INFO    ] Finished processing BAM request
2019-01-18 07:30:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204390   8 58501 27024037 A  ERROR'
2019-01-18 07:30:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:30:24 [DEBUG   ] spawn_process: at 2019-01-18 07:30:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:30:39 [DEBUG   ] Got command BAM from MCS: ref #1204396
2019-01-18 07:30:39 [INFO    ] Finished processing BAM request
2019-01-18 07:30:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204396   8 58501 27039033 A  ERROR'
2019-01-18 07:30:39 [DEBUG   ] Got command BAM from MCS: ref #1204397
2019-01-18 07:30:39 [INFO    ] Finished processing BAM request
2019-01-18 07:30:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204397   8 58501 27039037 A  ERROR'
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:30:39 [DEBUG   ] spawn_process: at 2019-01-18 07:30:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:30:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:30:54 [DEBUG   ] Got command BAM from MCS: ref #1204399
2019-01-18 07:30:54 [INFO    ] Finished processing BAM request
2019-01-18 07:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204399   8 58501 27054029 A  ERROR'
2019-01-18 07:30:54 [DEBUG   ] Got command BAM from MCS: ref #1204398
2019-01-18 07:30:54 [INFO    ] Finished processing BAM request
2019-01-18 07:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204398   8 58501 27054037 A  ERROR'
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:30:54 [DEBUG   ] spawn_process: at 2019-01-18 07:30:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:31:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:31:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:31:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:31:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:31:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:31:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:31:02 [DEBUG   ] Finished updating board flags in 1.143 seconds
2019-01-18 07:31:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 07:31:05 [DEBUG   ] Got command RPT from MCS: ref #1204400
2019-01-18 07:31:05 [DEBUG   ] summary = ERROR
2019-01-18 07:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204400  13 58501 27065897 A  ERRORERROR'
2019-01-18 07:31:05 [DEBUG   ] Got command RPT from MCS: ref #1204401
2019-01-18 07:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204401  77 58501 27065898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:31:09 [DEBUG   ] Got command BAM from MCS: ref #1204417
2019-01-18 07:31:09 [INFO    ] Finished processing BAM request
2019-01-18 07:31:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204417   8 58501 27069033 A  ERROR'
2019-01-18 07:31:09 [DEBUG   ] Got command BAM from MCS: ref #1204418
2019-01-18 07:31:09 [INFO    ] Finished processing BAM request
2019-01-18 07:31:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204418   8 58501 27069037 A  ERROR'
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:31:09 [DEBUG   ] spawn_process: at 2019-01-18 07:31:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:31:24 [DEBUG   ] Got command BAM from MCS: ref #1204419
2019-01-18 07:31:24 [INFO    ] Finished processing BAM request
2019-01-18 07:31:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204419   8 58501 27084033 A  ERROR'
2019-01-18 07:31:24 [DEBUG   ] Got command BAM from MCS: ref #1204420
2019-01-18 07:31:24 [INFO    ] Finished processing BAM request
2019-01-18 07:31:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204420   8 58501 27084037 A  ERROR'
2019-01-18 07:31:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:31:24 [DEBUG   ] spawn_process: at 2019-01-18 07:31:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:31:39 [DEBUG   ] Got command BAM from MCS: ref #1204422
2019-01-18 07:31:39 [INFO    ] Finished processing BAM request
2019-01-18 07:31:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204422   8 58501 27099029 A  ERROR'
2019-01-18 07:31:39 [DEBUG   ] Got command BAM from MCS: ref #1204421
2019-01-18 07:31:39 [INFO    ] Finished processing BAM request
2019-01-18 07:31:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204421   8 58501 27099033 A  ERROR'
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:31:39 [DEBUG   ] spawn_process: at 2019-01-18 07:31:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:31:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:31:54 [DEBUG   ] Got command BAM from MCS: ref #1204423
2019-01-18 07:31:54 [INFO    ] Finished processing BAM request
2019-01-18 07:31:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204423   8 58501 27114033 A  ERROR'
2019-01-18 07:31:54 [DEBUG   ] Got command BAM from MCS: ref #1204424
2019-01-18 07:31:54 [INFO    ] Finished processing BAM request
2019-01-18 07:31:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204424   8 58501 27114037 A  ERROR'
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:31:54 [DEBUG   ] spawn_process: at 2019-01-18 07:31:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:32:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:32:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:32:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:32:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 07:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:32:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:32:02 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-18 07:32:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:32:09 [DEBUG   ] Got command BAM from MCS: ref #1204425
2019-01-18 07:32:09 [INFO    ] Finished processing BAM request
2019-01-18 07:32:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204425   8 58501 27129033 A  ERROR'
2019-01-18 07:32:09 [DEBUG   ] Got command BAM from MCS: ref #1204426
2019-01-18 07:32:09 [INFO    ] Finished processing BAM request
2019-01-18 07:32:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204426   8 58501 27129037 A  ERROR'
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:32:09 [DEBUG   ] spawn_process: at 2019-01-18 07:32:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:32:24 [DEBUG   ] Got command BAM from MCS: ref #1204427
2019-01-18 07:32:24 [INFO    ] Finished processing BAM request
2019-01-18 07:32:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204427   8 58501 27144025 A  ERROR'
2019-01-18 07:32:24 [DEBUG   ] Got command BAM from MCS: ref #1204428
2019-01-18 07:32:24 [INFO    ] Finished processing BAM request
2019-01-18 07:32:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204428   8 58501 27144029 A  ERROR'
2019-01-18 07:32:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:32:24 [DEBUG   ] spawn_process: at 2019-01-18 07:32:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:32:25 [DEBUG   ] Got command RPT from MCS: ref #1204429
2019-01-18 07:32:25 [DEBUG   ] summary = ERROR
2019-01-18 07:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204429  13 58501 27145977 A  ERRORERROR'
2019-01-18 07:32:26 [DEBUG   ] Got command RPT from MCS: ref #1204430
2019-01-18 07:32:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204430  77 58501 27146181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:32:26 [DEBUG   ] Got command RPT from MCS: ref #1204431
2019-01-18 07:32:26 [DEBUG   ] summary = ERROR
2019-01-18 07:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204431  13 58501 27146373 A  ERRORERROR'
2019-01-18 07:32:26 [DEBUG   ] Got command RPT from MCS: ref #1204432
2019-01-18 07:32:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204432  77 58501 27146577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:32:26 [DEBUG   ] Got command RPT from MCS: ref #1204433
2019-01-18 07:32:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204433  12 58501 27146781 A  ERRORB¢ff'
2019-01-18 07:32:39 [DEBUG   ] Got command BAM from MCS: ref #1204435
2019-01-18 07:32:39 [INFO    ] Finished processing BAM request
2019-01-18 07:32:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204435   8 58501 27159025 A  ERROR'
2019-01-18 07:32:39 [DEBUG   ] Got command BAM from MCS: ref #1204434
2019-01-18 07:32:39 [INFO    ] Finished processing BAM request
2019-01-18 07:32:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204434   8 58501 27159029 A  ERROR'
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:32:39 [DEBUG   ] spawn_process: at 2019-01-18 07:32:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:32:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:32:54 [DEBUG   ] Got command BAM from MCS: ref #1204437
2019-01-18 07:32:54 [INFO    ] Finished processing BAM request
2019-01-18 07:32:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204437   8 58501 27174033 A  ERROR'
2019-01-18 07:32:54 [DEBUG   ] Got command BAM from MCS: ref #1204436
2019-01-18 07:32:54 [INFO    ] Finished processing BAM request
2019-01-18 07:32:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:32:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204436   8 58501 27174037 A  ERROR'
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:32:54 [DEBUG   ] spawn_process: at 2019-01-18 07:32:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:33:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:33:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:33:02 [DEBUG   ] Finished updating board flags in 1.261 seconds
2019-01-18 07:33:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:33:09 [DEBUG   ] Got command BAM from MCS: ref #1204439
2019-01-18 07:33:09 [INFO    ] Finished processing BAM request
2019-01-18 07:33:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204439   8 58501 27189025 A  ERROR'
2019-01-18 07:33:09 [DEBUG   ] Got command BAM from MCS: ref #1204438
2019-01-18 07:33:09 [INFO    ] Finished processing BAM request
2019-01-18 07:33:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204438   8 58501 27189029 A  ERROR'
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:33:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:33:09 [DEBUG   ] spawn_process: at 2019-01-18 07:33:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:33:24 [DEBUG   ] Got command BAM from MCS: ref #1204441
2019-01-18 07:33:24 [INFO    ] Finished processing BAM request
2019-01-18 07:33:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204441   8 58501 27204029 A  ERROR'
2019-01-18 07:33:24 [DEBUG   ] Got command BAM from MCS: ref #1204440
2019-01-18 07:33:24 [INFO    ] Finished processing BAM request
2019-01-18 07:33:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204440   8 58501 27204033 A  ERROR'
2019-01-18 07:33:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:33:24 [DEBUG   ] spawn_process: at 2019-01-18 07:33:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:33:39 [DEBUG   ] Got command BAM from MCS: ref #1204446
2019-01-18 07:33:39 [INFO    ] Finished processing BAM request
2019-01-18 07:33:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204446   8 58501 27219025 A  ERROR'
2019-01-18 07:33:39 [DEBUG   ] Got command BAM from MCS: ref #1204447
2019-01-18 07:33:39 [INFO    ] Finished processing BAM request
2019-01-18 07:33:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204447   8 58501 27219029 A  ERROR'
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:33:39 [DEBUG   ] spawn_process: at 2019-01-18 07:33:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:33:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:33:54 [DEBUG   ] Got command BAM from MCS: ref #1204449
2019-01-18 07:33:54 [INFO    ] Finished processing BAM request
2019-01-18 07:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204449   8 58501 27234033 A  ERROR'
2019-01-18 07:33:54 [DEBUG   ] Got command BAM from MCS: ref #1204448
2019-01-18 07:33:54 [INFO    ] Finished processing BAM request
2019-01-18 07:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204448   8 58501 27234037 A  ERROR'
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:33:54 [DEBUG   ] spawn_process: at 2019-01-18 07:33:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:34:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:34:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:34:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:34:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:34:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:34:03 [DEBUG   ] Finished updating board flags in 1.754 seconds
2019-01-18 07:34:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:34:09 [DEBUG   ] Got command BAM from MCS: ref #1204450
2019-01-18 07:34:09 [INFO    ] Finished processing BAM request
2019-01-18 07:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204450   8 58501 27249025 A  ERROR'
2019-01-18 07:34:09 [DEBUG   ] Got command BAM from MCS: ref #1204451
2019-01-18 07:34:09 [INFO    ] Finished processing BAM request
2019-01-18 07:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204451   8 58501 27249029 A  ERROR'
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:34:09 [DEBUG   ] spawn_process: at 2019-01-18 07:34:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:34:24 [DEBUG   ] Got command BAM from MCS: ref #1204453
2019-01-18 07:34:24 [INFO    ] Finished processing BAM request
2019-01-18 07:34:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204453   8 58501 27264029 A  ERROR'
2019-01-18 07:34:24 [DEBUG   ] Got command BAM from MCS: ref #1204452
2019-01-18 07:34:24 [INFO    ] Finished processing BAM request
2019-01-18 07:34:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204452   8 58501 27264033 A  ERROR'
2019-01-18 07:34:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:34:24 [DEBUG   ] spawn_process: at 2019-01-18 07:34:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:34:39 [DEBUG   ] Got command BAM from MCS: ref #1204454
2019-01-18 07:34:39 [INFO    ] Finished processing BAM request
2019-01-18 07:34:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204454   8 58501 27279025 A  ERROR'
2019-01-18 07:34:39 [DEBUG   ] Got command BAM from MCS: ref #1204455
2019-01-18 07:34:39 [INFO    ] Finished processing BAM request
2019-01-18 07:34:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204455   8 58501 27279029 A  ERROR'
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:34:39 [DEBUG   ] spawn_process: at 2019-01-18 07:34:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:34:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:34:54 [DEBUG   ] Got command BAM from MCS: ref #1204456
2019-01-18 07:34:54 [INFO    ] Finished processing BAM request
2019-01-18 07:34:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204456   8 58501 27294033 A  ERROR'
2019-01-18 07:34:54 [DEBUG   ] Got command BAM from MCS: ref #1204457
2019-01-18 07:34:54 [INFO    ] Finished processing BAM request
2019-01-18 07:34:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204457   8 58501 27294041 A  ERROR'
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:34:54 [DEBUG   ] spawn_process: at 2019-01-18 07:34:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 07:35:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:35:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:35:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:35:02 [DEBUG   ] Finished updating board flags in 1.063 seconds
2019-01-18 07:35:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:35:09 [DEBUG   ] Got command BAM from MCS: ref #1204459
2019-01-18 07:35:09 [INFO    ] Finished processing BAM request
2019-01-18 07:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204459   8 58501 27309033 A  ERROR'
2019-01-18 07:35:09 [DEBUG   ] Got command BAM from MCS: ref #1204458
2019-01-18 07:35:09 [INFO    ] Finished processing BAM request
2019-01-18 07:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204458   8 58501 27309041 A  ERROR'
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:35:09 [DEBUG   ] spawn_process: at 2019-01-18 07:35:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:35:24 [DEBUG   ] Got command BAM from MCS: ref #1204460
2019-01-18 07:35:24 [INFO    ] Finished processing BAM request
2019-01-18 07:35:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204460   8 58501 27324033 A  ERROR'
2019-01-18 07:35:24 [DEBUG   ] Got command BAM from MCS: ref #1204461
2019-01-18 07:35:24 [INFO    ] Finished processing BAM request
2019-01-18 07:35:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204461   8 58501 27324037 A  ERROR'
2019-01-18 07:35:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:35:24 [DEBUG   ] spawn_process: at 2019-01-18 07:35:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:35:39 [DEBUG   ] Got command BAM from MCS: ref #1204462
2019-01-18 07:35:39 [INFO    ] Finished processing BAM request
2019-01-18 07:35:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204462   8 58501 27339029 A  ERROR'
2019-01-18 07:35:39 [DEBUG   ] Got command BAM from MCS: ref #1204463
2019-01-18 07:35:39 [INFO    ] Finished processing BAM request
2019-01-18 07:35:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204463   8 58501 27339033 A  ERROR'
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:35:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:35:39 [DEBUG   ] spawn_process: at 2019-01-18 07:35:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:35:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:35:54 [DEBUG   ] Got command BAM from MCS: ref #1204465
2019-01-18 07:35:54 [INFO    ] Finished processing BAM request
2019-01-18 07:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204465   8 58501 27354025 A  ERROR'
2019-01-18 07:35:54 [DEBUG   ] Got command BAM from MCS: ref #1204464
2019-01-18 07:35:54 [INFO    ] Finished processing BAM request
2019-01-18 07:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204464   8 58501 27354029 A  ERROR'
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:35:54 [DEBUG   ] spawn_process: at 2019-01-18 07:35:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:36:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:36:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:36:02 [WARNING ] (13, 1, 'bot')
2019-01-18 07:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:36:02 [DEBUG   ] Finished updating board flags in 0.985 seconds
2019-01-18 07:36:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 07:36:05 [DEBUG   ] Got command RPT from MCS: ref #1204466
2019-01-18 07:36:05 [DEBUG   ] summary = ERROR
2019-01-18 07:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204466  13 58501 27365897 A  ERRORERROR'
2019-01-18 07:36:05 [DEBUG   ] Got command RPT from MCS: ref #1204467
2019-01-18 07:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204467  77 58501 27365898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:36:09 [DEBUG   ] Got command BAM from MCS: ref #1204484
2019-01-18 07:36:09 [INFO    ] Finished processing BAM request
2019-01-18 07:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204484   8 58501 27369033 A  ERROR'
2019-01-18 07:36:09 [DEBUG   ] Got command BAM from MCS: ref #1204483
2019-01-18 07:36:09 [INFO    ] Finished processing BAM request
2019-01-18 07:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204483   8 58501 27369037 A  ERROR'
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:36:09 [DEBUG   ] spawn_process: at 2019-01-18 07:36:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:36:24 [DEBUG   ] Got command BAM from MCS: ref #1204486
2019-01-18 07:36:24 [INFO    ] Finished processing BAM request
2019-01-18 07:36:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204486   8 58501 27384025 A  ERROR'
2019-01-18 07:36:24 [DEBUG   ] Got command BAM from MCS: ref #1204485
2019-01-18 07:36:24 [INFO    ] Finished processing BAM request
2019-01-18 07:36:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204485   8 58501 27384029 A  ERROR'
2019-01-18 07:36:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:36:24 [DEBUG   ] spawn_process: at 2019-01-18 07:36:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:36:39 [DEBUG   ] Got command BAM from MCS: ref #1204491
2019-01-18 07:36:39 [INFO    ] Finished processing BAM request
2019-01-18 07:36:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204491   8 58501 27399029 A  ERROR'
2019-01-18 07:36:39 [DEBUG   ] Got command BAM from MCS: ref #1204492
2019-01-18 07:36:39 [INFO    ] Finished processing BAM request
2019-01-18 07:36:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204492   8 58501 27399033 A  ERROR'
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:36:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:36:39 [DEBUG   ] spawn_process: at 2019-01-18 07:36:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:36:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:36:54 [DEBUG   ] Got command BAM from MCS: ref #1204493
2019-01-18 07:36:54 [INFO    ] Finished processing BAM request
2019-01-18 07:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204493   8 58501 27414029 A  ERROR'
2019-01-18 07:36:54 [DEBUG   ] Got command BAM from MCS: ref #1204494
2019-01-18 07:36:54 [INFO    ] Finished processing BAM request
2019-01-18 07:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204494   8 58501 27414037 A  ERROR'
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:36:54 [DEBUG   ] spawn_process: at 2019-01-18 07:36:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:37:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:37:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:37:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:37:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:37:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:37:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:37:03 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-01-18 07:37:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:37:09 [DEBUG   ] Got command BAM from MCS: ref #1204495
2019-01-18 07:37:09 [INFO    ] Finished processing BAM request
2019-01-18 07:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204495   8 58501 27429033 A  ERROR'
2019-01-18 07:37:09 [DEBUG   ] Got command BAM from MCS: ref #1204496
2019-01-18 07:37:09 [INFO    ] Finished processing BAM request
2019-01-18 07:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204496   8 58501 27429037 A  ERROR'
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:37:09 [DEBUG   ] spawn_process: at 2019-01-18 07:37:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:37:24 [DEBUG   ] Got command BAM from MCS: ref #1204499
2019-01-18 07:37:24 [INFO    ] Finished processing BAM request
2019-01-18 07:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204499   8 58501 27444025 A  ERROR'
2019-01-18 07:37:24 [DEBUG   ] Got command BAM from MCS: ref #1204500
2019-01-18 07:37:24 [INFO    ] Finished processing BAM request
2019-01-18 07:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204500   8 58501 27444029 A  ERROR'
2019-01-18 07:37:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:37:24 [DEBUG   ] spawn_process: at 2019-01-18 07:37:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:37:26 [DEBUG   ] Got command RPT from MCS: ref #1204501
2019-01-18 07:37:26 [DEBUG   ] summary = ERROR
2019-01-18 07:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204501  13 58501 27446057 A  ERRORERROR'
2019-01-18 07:37:26 [DEBUG   ] Got command RPT from MCS: ref #1204502
2019-01-18 07:37:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204502  77 58501 27446261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:37:26 [DEBUG   ] Got command RPT from MCS: ref #1204503
2019-01-18 07:37:26 [DEBUG   ] summary = ERROR
2019-01-18 07:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204503  13 58501 27446465 A  ERRORERROR'
2019-01-18 07:37:26 [DEBUG   ] Got command RPT from MCS: ref #1204505
2019-01-18 07:37:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204505  77 58501 27446669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:37:26 [DEBUG   ] Got command RPT from MCS: ref #1204507
2019-01-18 07:37:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204507  12 58501 27446861 A  ERRORB£ff'
2019-01-18 07:37:39 [DEBUG   ] Got command BAM from MCS: ref #1204511
2019-01-18 07:37:39 [INFO    ] Finished processing BAM request
2019-01-18 07:37:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204511   8 58501 27459033 A  ERROR'
2019-01-18 07:37:39 [DEBUG   ] Got command BAM from MCS: ref #1204512
2019-01-18 07:37:39 [INFO    ] Finished processing BAM request
2019-01-18 07:37:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204512   8 58501 27459037 A  ERROR'
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:37:39 [DEBUG   ] spawn_process: at 2019-01-18 07:37:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:37:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:37:54 [DEBUG   ] Got command BAM from MCS: ref #1204514
2019-01-18 07:37:54 [INFO    ] Finished processing BAM request
2019-01-18 07:37:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204514   8 58501 27474025 A  ERROR'
2019-01-18 07:37:54 [DEBUG   ] Got command BAM from MCS: ref #1204513
2019-01-18 07:37:54 [INFO    ] Finished processing BAM request
2019-01-18 07:37:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:37:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204513   8 58501 27474029 A  ERROR'
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:37:54 [DEBUG   ] spawn_process: at 2019-01-18 07:37:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-18 07:38:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:38:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:38:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:38:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:38:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:38:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:38:03 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-01-18 07:38:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:38:09 [DEBUG   ] Got command BAM from MCS: ref #1204516
2019-01-18 07:38:09 [INFO    ] Finished processing BAM request
2019-01-18 07:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204516   8 58501 27489025 A  ERROR'
2019-01-18 07:38:09 [DEBUG   ] Got command BAM from MCS: ref #1204515
2019-01-18 07:38:09 [INFO    ] Finished processing BAM request
2019-01-18 07:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204515   8 58501 27489029 A  ERROR'
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:38:09 [DEBUG   ] spawn_process: at 2019-01-18 07:38:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:38:24 [DEBUG   ] Got command BAM from MCS: ref #1204517
2019-01-18 07:38:24 [INFO    ] Finished processing BAM request
2019-01-18 07:38:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204517   8 58501 27504025 A  ERROR'
2019-01-18 07:38:24 [DEBUG   ] Got command BAM from MCS: ref #1204518
2019-01-18 07:38:24 [INFO    ] Finished processing BAM request
2019-01-18 07:38:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204518   8 58501 27504029 A  ERROR'
2019-01-18 07:38:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:38:24 [DEBUG   ] spawn_process: at 2019-01-18 07:38:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:38:39 [DEBUG   ] Got command BAM from MCS: ref #1204520
2019-01-18 07:38:39 [INFO    ] Finished processing BAM request
2019-01-18 07:38:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204520   8 58501 27519029 A  ERROR'
2019-01-18 07:38:39 [DEBUG   ] Got command BAM from MCS: ref #1204519
2019-01-18 07:38:39 [INFO    ] Finished processing BAM request
2019-01-18 07:38:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204519   8 58501 27519033 A  ERROR'
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:38:39 [DEBUG   ] spawn_process: at 2019-01-18 07:38:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:38:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:38:54 [DEBUG   ] Got command BAM from MCS: ref #1204522
2019-01-18 07:38:54 [INFO    ] Finished processing BAM request
2019-01-18 07:38:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204522   8 58501 27534033 A  ERROR'
2019-01-18 07:38:54 [DEBUG   ] Got command BAM from MCS: ref #1204521
2019-01-18 07:38:54 [INFO    ] Finished processing BAM request
2019-01-18 07:38:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204521   8 58501 27534041 A  ERROR'
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:38:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:38:54 [DEBUG   ] spawn_process: at 2019-01-18 07:38:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:39:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:39:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:39:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:39:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:39:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:39:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:39:03 [DEBUG   ] Finished updating board flags in 0.999 seconds
2019-01-18 07:39:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 07:39:09 [DEBUG   ] Got command BAM from MCS: ref #1204523
2019-01-18 07:39:09 [INFO    ] Finished processing BAM request
2019-01-18 07:39:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204523   8 58501 27549025 A  ERROR'
2019-01-18 07:39:09 [DEBUG   ] Got command BAM from MCS: ref #1204524
2019-01-18 07:39:09 [INFO    ] Finished processing BAM request
2019-01-18 07:39:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204524   8 58501 27549029 A  ERROR'
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:39:09 [DEBUG   ] spawn_process: at 2019-01-18 07:39:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:39:24 [DEBUG   ] Got command BAM from MCS: ref #1204525
2019-01-18 07:39:24 [INFO    ] Finished processing BAM request
2019-01-18 07:39:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204525   8 58501 27564029 A  ERROR'
2019-01-18 07:39:24 [DEBUG   ] Got command BAM from MCS: ref #1204526
2019-01-18 07:39:24 [INFO    ] Finished processing BAM request
2019-01-18 07:39:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204526   8 58501 27564033 A  ERROR'
2019-01-18 07:39:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:39:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:39:24 [DEBUG   ] spawn_process: at 2019-01-18 07:39:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:39:39 [DEBUG   ] Got command BAM from MCS: ref #1204532
2019-01-18 07:39:39 [INFO    ] Finished processing BAM request
2019-01-18 07:39:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204532   8 58501 27579025 A  ERROR'
2019-01-18 07:39:39 [DEBUG   ] Got command BAM from MCS: ref #1204531
2019-01-18 07:39:39 [INFO    ] Finished processing BAM request
2019-01-18 07:39:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204531   8 58501 27579029 A  ERROR'
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:39:39 [DEBUG   ] spawn_process: at 2019-01-18 07:39:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:39:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 07:39:54 [DEBUG   ] Got command BAM from MCS: ref #1204534
2019-01-18 07:39:54 [INFO    ] Finished processing BAM request
2019-01-18 07:39:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204534   8 58501 27594033 A  ERROR'
2019-01-18 07:39:54 [DEBUG   ] Got command BAM from MCS: ref #1204533
2019-01-18 07:39:54 [INFO    ] Finished processing BAM request
2019-01-18 07:39:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204533   8 58501 27594037 A  ERROR'
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:39:54 [DEBUG   ] spawn_process: at 2019-01-18 07:39:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-18 07:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:40:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:40:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:40:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:40:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:40:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:40:03 [DEBUG   ] Finished updating board flags in 1.316 seconds
2019-01-18 07:40:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 07:40:09 [DEBUG   ] Got command BAM from MCS: ref #1204535
2019-01-18 07:40:09 [INFO    ] Finished processing BAM request
2019-01-18 07:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204535   8 58501 27609033 A  ERROR'
2019-01-18 07:40:09 [DEBUG   ] Got command BAM from MCS: ref #1204536
2019-01-18 07:40:09 [INFO    ] Finished processing BAM request
2019-01-18 07:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204536   8 58501 27609037 A  ERROR'
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:40:09 [DEBUG   ] spawn_process: at 2019-01-18 07:40:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:40:24 [DEBUG   ] Got command BAM from MCS: ref #1204537
2019-01-18 07:40:24 [INFO    ] Finished processing BAM request
2019-01-18 07:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204537   8 58501 27624033 A  ERROR'
2019-01-18 07:40:24 [DEBUG   ] Got command BAM from MCS: ref #1204538
2019-01-18 07:40:24 [INFO    ] Finished processing BAM request
2019-01-18 07:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204538   8 58501 27624037 A  ERROR'
2019-01-18 07:40:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:40:24 [DEBUG   ] spawn_process: at 2019-01-18 07:40:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:40:39 [DEBUG   ] Got command BAM from MCS: ref #1204540
2019-01-18 07:40:39 [INFO    ] Finished processing BAM request
2019-01-18 07:40:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204540   8 58501 27639029 A  ERROR'
2019-01-18 07:40:39 [DEBUG   ] Got command BAM from MCS: ref #1204539
2019-01-18 07:40:39 [INFO    ] Finished processing BAM request
2019-01-18 07:40:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204539   8 58501 27639033 A  ERROR'
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:40:39 [DEBUG   ] spawn_process: at 2019-01-18 07:40:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:40:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:40:54 [DEBUG   ] Got command BAM from MCS: ref #1204542
2019-01-18 07:40:54 [INFO    ] Finished processing BAM request
2019-01-18 07:40:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204542   8 58501 27654033 A  ERROR'
2019-01-18 07:40:54 [DEBUG   ] Got command BAM from MCS: ref #1204541
2019-01-18 07:40:54 [INFO    ] Finished processing BAM request
2019-01-18 07:40:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204541   8 58501 27654037 A  ERROR'
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:40:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:40:54 [DEBUG   ] spawn_process: at 2019-01-18 07:40:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 07:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 07:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-18 07:41:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:41:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:41:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:41:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:41:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:41:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:41:03 [DEBUG   ] Finished updating board flags in 1.121 seconds
2019-01-18 07:41:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:41:05 [DEBUG   ] Got command RPT from MCS: ref #1204543
2019-01-18 07:41:05 [DEBUG   ] summary = ERROR
2019-01-18 07:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204543  13 58501 27665893 A  ERRORERROR'
2019-01-18 07:41:05 [DEBUG   ] Got command RPT from MCS: ref #1204544
2019-01-18 07:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204544  77 58501 27665894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:41:09 [DEBUG   ] Got command BAM from MCS: ref #1204560
2019-01-18 07:41:09 [INFO    ] Finished processing BAM request
2019-01-18 07:41:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204560   8 58501 27669029 A  ERROR'
2019-01-18 07:41:09 [DEBUG   ] Got command BAM from MCS: ref #1204561
2019-01-18 07:41:09 [INFO    ] Finished processing BAM request
2019-01-18 07:41:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204561   8 58501 27669033 A  ERROR'
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:41:09 [DEBUG   ] spawn_process: at 2019-01-18 07:41:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:41:24 [DEBUG   ] Got command BAM from MCS: ref #1204563
2019-01-18 07:41:24 [INFO    ] Finished processing BAM request
2019-01-18 07:41:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204563   8 58501 27684029 A  ERROR'
2019-01-18 07:41:24 [DEBUG   ] Got command BAM from MCS: ref #1204562
2019-01-18 07:41:24 [INFO    ] Finished processing BAM request
2019-01-18 07:41:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204562   8 58501 27684033 A  ERROR'
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:41:24 [DEBUG   ] spawn_process: at 2019-01-18 07:41:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:41:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:41:39 [DEBUG   ] Got command BAM from MCS: ref #1204564
2019-01-18 07:41:39 [INFO    ] Finished processing BAM request
2019-01-18 07:41:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204564   8 58501 27699029 A  ERROR'
2019-01-18 07:41:39 [DEBUG   ] Got command BAM from MCS: ref #1204565
2019-01-18 07:41:39 [INFO    ] Finished processing BAM request
2019-01-18 07:41:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204565   8 58501 27699033 A  ERROR'
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:41:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:41:39 [DEBUG   ] spawn_process: at 2019-01-18 07:41:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:41:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:41:54 [DEBUG   ] Got command BAM from MCS: ref #1204567
2019-01-18 07:41:54 [INFO    ] Finished processing BAM request
2019-01-18 07:41:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204567   8 58501 27714033 A  ERROR'
2019-01-18 07:41:54 [DEBUG   ] Got command BAM from MCS: ref #1204566
2019-01-18 07:41:54 [INFO    ] Finished processing BAM request
2019-01-18 07:41:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204566   8 58501 27714037 A  ERROR'
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:41:54 [DEBUG   ] spawn_process: at 2019-01-18 07:41:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 07:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-18 07:42:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:42:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:42:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:42:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:42:03 [WARNING ] (13, 1, 'bot')
2019-01-18 07:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:42:03 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-01-18 07:42:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:42:09 [DEBUG   ] Got command BAM from MCS: ref #1204569
2019-01-18 07:42:09 [INFO    ] Finished processing BAM request
2019-01-18 07:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204569   8 58501 27729025 A  ERROR'
2019-01-18 07:42:09 [DEBUG   ] Got command BAM from MCS: ref #1204568
2019-01-18 07:42:09 [INFO    ] Finished processing BAM request
2019-01-18 07:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204568   8 58501 27729029 A  ERROR'
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:42:09 [DEBUG   ] spawn_process: at 2019-01-18 07:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:42:24 [DEBUG   ] Got command BAM from MCS: ref #1204571
2019-01-18 07:42:24 [INFO    ] Finished processing BAM request
2019-01-18 07:42:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204571   8 58501 27744034 A  ERROR'
2019-01-18 07:42:24 [DEBUG   ] Got command BAM from MCS: ref #1204570
2019-01-18 07:42:24 [INFO    ] Finished processing BAM request
2019-01-18 07:42:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204570   8 58501 27744038 A  ERROR'
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:42:24 [DEBUG   ] spawn_process: at 2019-01-18 07:42:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:42:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:42:26 [DEBUG   ] Got command RPT from MCS: ref #1204572
2019-01-18 07:42:26 [DEBUG   ] summary = ERROR
2019-01-18 07:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204572  13 58501 27746149 A  ERRORERROR'
2019-01-18 07:42:26 [DEBUG   ] Got command RPT from MCS: ref #1204573
2019-01-18 07:42:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204573  77 58501 27746353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:42:26 [DEBUG   ] Got command RPT from MCS: ref #1204574
2019-01-18 07:42:26 [DEBUG   ] summary = ERROR
2019-01-18 07:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204574  13 58501 27746557 A  ERRORERROR'
2019-01-18 07:42:26 [DEBUG   ] Got command RPT from MCS: ref #1204575
2019-01-18 07:42:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204575  77 58501 27746749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:42:26 [DEBUG   ] Got command RPT from MCS: ref #1204576
2019-01-18 07:42:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204576  12 58501 27746953 A  ERRORB£ff'
2019-01-18 07:42:39 [DEBUG   ] Got command BAM from MCS: ref #1204581
2019-01-18 07:42:39 [INFO    ] Finished processing BAM request
2019-01-18 07:42:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204581   8 58501 27759033 A  ERROR'
2019-01-18 07:42:39 [DEBUG   ] Got command BAM from MCS: ref #1204582
2019-01-18 07:42:39 [INFO    ] Finished processing BAM request
2019-01-18 07:42:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204582   8 58501 27759037 A  ERROR'
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:42:39 [DEBUG   ] spawn_process: at 2019-01-18 07:42:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:42:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:42:54 [DEBUG   ] Got command BAM from MCS: ref #1204584
2019-01-18 07:42:54 [INFO    ] Finished processing BAM request
2019-01-18 07:42:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204584   8 58501 27774033 A  ERROR'
2019-01-18 07:42:54 [DEBUG   ] Got command BAM from MCS: ref #1204583
2019-01-18 07:42:54 [INFO    ] Finished processing BAM request
2019-01-18 07:42:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:42:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204583   8 58501 27774037 A  ERROR'
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:42:54 [DEBUG   ] spawn_process: at 2019-01-18 07:42:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 07:43:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:43:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:43:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:43:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:43:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:43:04 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-18 07:43:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 07:43:09 [DEBUG   ] Got command BAM from MCS: ref #1204585
2019-01-18 07:43:09 [INFO    ] Finished processing BAM request
2019-01-18 07:43:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204585   8 58501 27789029 A  ERROR'
2019-01-18 07:43:09 [DEBUG   ] Got command BAM from MCS: ref #1204586
2019-01-18 07:43:09 [INFO    ] Finished processing BAM request
2019-01-18 07:43:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204586   8 58501 27789033 A  ERROR'
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:43:09 [DEBUG   ] spawn_process: at 2019-01-18 07:43:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:43:24 [DEBUG   ] Got command BAM from MCS: ref #1204588
2019-01-18 07:43:24 [INFO    ] Finished processing BAM request
2019-01-18 07:43:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204588   8 58501 27804025 A  ERROR'
2019-01-18 07:43:24 [DEBUG   ] Got command BAM from MCS: ref #1204587
2019-01-18 07:43:24 [INFO    ] Finished processing BAM request
2019-01-18 07:43:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204587   8 58501 27804029 A  ERROR'
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:43:24 [DEBUG   ] spawn_process: at 2019-01-18 07:43:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:43:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:43:39 [DEBUG   ] Got command BAM from MCS: ref #1204590
2019-01-18 07:43:39 [INFO    ] Finished processing BAM request
2019-01-18 07:43:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204590   8 58501 27819025 A  ERROR'
2019-01-18 07:43:39 [DEBUG   ] Got command BAM from MCS: ref #1204589
2019-01-18 07:43:39 [INFO    ] Finished processing BAM request
2019-01-18 07:43:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204589   8 58501 27819029 A  ERROR'
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:43:39 [DEBUG   ] spawn_process: at 2019-01-18 07:43:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:43:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:43:54 [DEBUG   ] Got command BAM from MCS: ref #1204592
2019-01-18 07:43:54 [INFO    ] Finished processing BAM request
2019-01-18 07:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204592   8 58501 27834025 A  ERROR'
2019-01-18 07:43:54 [DEBUG   ] Got command BAM from MCS: ref #1204591
2019-01-18 07:43:54 [INFO    ] Finished processing BAM request
2019-01-18 07:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204591   8 58501 27834029 A  ERROR'
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:43:54 [DEBUG   ] spawn_process: at 2019-01-18 07:43:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:44:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:44:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 07:44:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:44:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:44:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:44:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:44:04 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-18 07:44:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:44:09 [DEBUG   ] Got command BAM from MCS: ref #1204594
2019-01-18 07:44:09 [INFO    ] Finished processing BAM request
2019-01-18 07:44:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204594   8 58501 27849029 A  ERROR'
2019-01-18 07:44:09 [DEBUG   ] Got command BAM from MCS: ref #1204593
2019-01-18 07:44:09 [INFO    ] Finished processing BAM request
2019-01-18 07:44:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204593   8 58501 27849033 A  ERROR'
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:44:09 [DEBUG   ] spawn_process: at 2019-01-18 07:44:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:44:24 [DEBUG   ] Got command BAM from MCS: ref #1204596
2019-01-18 07:44:24 [INFO    ] Finished processing BAM request
2019-01-18 07:44:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204596   8 58501 27864025 A  ERROR'
2019-01-18 07:44:24 [DEBUG   ] Got command BAM from MCS: ref #1204595
2019-01-18 07:44:24 [INFO    ] Finished processing BAM request
2019-01-18 07:44:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204595   8 58501 27864029 A  ERROR'
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:44:24 [DEBUG   ] spawn_process: at 2019-01-18 07:44:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:44:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:44:39 [DEBUG   ] Got command BAM from MCS: ref #1204598
2019-01-18 07:44:39 [INFO    ] Finished processing BAM request
2019-01-18 07:44:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204598   8 58501 27879025 A  ERROR'
2019-01-18 07:44:39 [DEBUG   ] Got command BAM from MCS: ref #1204597
2019-01-18 07:44:39 [INFO    ] Finished processing BAM request
2019-01-18 07:44:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204597   8 58501 27879029 A  ERROR'
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:44:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:44:39 [DEBUG   ] spawn_process: at 2019-01-18 07:44:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:44:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:44:54 [DEBUG   ] Got command BAM from MCS: ref #1204599
2019-01-18 07:44:54 [INFO    ] Finished processing BAM request
2019-01-18 07:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204599   8 58501 27894033 A  ERROR'
2019-01-18 07:44:54 [DEBUG   ] Got command BAM from MCS: ref #1204600
2019-01-18 07:44:54 [INFO    ] Finished processing BAM request
2019-01-18 07:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204600   8 58501 27894037 A  ERROR'
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:44:54 [DEBUG   ] spawn_process: at 2019-01-18 07:44:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 07:45:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:45:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:45:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:45:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:45:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:45:04 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-18 07:45:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:45:09 [DEBUG   ] Got command BAM from MCS: ref #1204602
2019-01-18 07:45:09 [INFO    ] Finished processing BAM request
2019-01-18 07:45:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204602   8 58501 27909025 A  ERROR'
2019-01-18 07:45:09 [DEBUG   ] Got command BAM from MCS: ref #1204601
2019-01-18 07:45:09 [INFO    ] Finished processing BAM request
2019-01-18 07:45:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204601   8 58501 27909029 A  ERROR'
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:45:09 [DEBUG   ] spawn_process: at 2019-01-18 07:45:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:45:24 [DEBUG   ] Got command BAM from MCS: ref #1204603
2019-01-18 07:45:24 [INFO    ] Finished processing BAM request
2019-01-18 07:45:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204603   8 58501 27924029 A  ERROR'
2019-01-18 07:45:24 [DEBUG   ] Got command BAM from MCS: ref #1204604
2019-01-18 07:45:24 [INFO    ] Finished processing BAM request
2019-01-18 07:45:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204604   8 58501 27924033 A  ERROR'
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:45:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:45:24 [DEBUG   ] spawn_process: at 2019-01-18 07:45:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:45:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:45:39 [DEBUG   ] Got command BAM from MCS: ref #1204609
2019-01-18 07:45:39 [INFO    ] Finished processing BAM request
2019-01-18 07:45:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204609   8 58501 27939029 A  ERROR'
2019-01-18 07:45:39 [DEBUG   ] Got command BAM from MCS: ref #1204610
2019-01-18 07:45:39 [INFO    ] Finished processing BAM request
2019-01-18 07:45:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204610   8 58501 27939033 A  ERROR'
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:45:39 [DEBUG   ] spawn_process: at 2019-01-18 07:45:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:45:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:45:54 [DEBUG   ] Got command BAM from MCS: ref #1204611
2019-01-18 07:45:54 [INFO    ] Finished processing BAM request
2019-01-18 07:45:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204611   8 58501 27954025 A  ERROR'
2019-01-18 07:45:54 [DEBUG   ] Got command BAM from MCS: ref #1204612
2019-01-18 07:45:54 [INFO    ] Finished processing BAM request
2019-01-18 07:45:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204612   8 58501 27954029 A  ERROR'
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:45:54 [DEBUG   ] spawn_process: at 2019-01-18 07:45:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:46:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:46:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 07:46:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:46:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:46:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:46:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:46:05 [DEBUG   ] Finished updating board flags in 2.333 seconds
2019-01-18 07:46:05 [DEBUG   ] Got command RPT from MCS: ref #1204613
2019-01-18 07:46:05 [DEBUG   ] summary = ERROR
2019-01-18 07:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204613  13 58501 27965901 A  ERRORERROR'
2019-01-18 07:46:05 [DEBUG   ] Got command RPT from MCS: ref #1204614
2019-01-18 07:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204614  77 58501 27965902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:46:09 [DEBUG   ] Got command BAM from MCS: ref #1204630
2019-01-18 07:46:09 [INFO    ] Finished processing BAM request
2019-01-18 07:46:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204630   8 58501 27969025 A  ERROR'
2019-01-18 07:46:09 [DEBUG   ] Got command BAM from MCS: ref #1204631
2019-01-18 07:46:09 [INFO    ] Finished processing BAM request
2019-01-18 07:46:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204631   8 58501 27969029 A  ERROR'
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:46:09 [DEBUG   ] spawn_process: at 2019-01-18 07:46:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:46:24 [DEBUG   ] Got command BAM from MCS: ref #1204632
2019-01-18 07:46:24 [INFO    ] Finished processing BAM request
2019-01-18 07:46:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204632   8 58501 27984025 A  ERROR'
2019-01-18 07:46:24 [DEBUG   ] Got command BAM from MCS: ref #1204633
2019-01-18 07:46:24 [INFO    ] Finished processing BAM request
2019-01-18 07:46:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204633   8 58501 27984029 A  ERROR'
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:46:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:46:24 [DEBUG   ] spawn_process: at 2019-01-18 07:46:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:46:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 07:46:39 [DEBUG   ] Got command BAM from MCS: ref #1204635
2019-01-18 07:46:39 [INFO    ] Finished processing BAM request
2019-01-18 07:46:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204635   8 58501 27999025 A  ERROR'
2019-01-18 07:46:39 [DEBUG   ] Got command BAM from MCS: ref #1204634
2019-01-18 07:46:39 [INFO    ] Finished processing BAM request
2019-01-18 07:46:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204634   8 58501 27999029 A  ERROR'
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:46:39 [DEBUG   ] spawn_process: at 2019-01-18 07:46:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:46:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:46:54 [DEBUG   ] Got command BAM from MCS: ref #1204636
2019-01-18 07:46:54 [INFO    ] Finished processing BAM request
2019-01-18 07:46:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204636   8 58501 28014029 A  ERROR'
2019-01-18 07:46:54 [DEBUG   ] Got command BAM from MCS: ref #1204637
2019-01-18 07:46:54 [INFO    ] Finished processing BAM request
2019-01-18 07:46:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204637   8 58501 28014033 A  ERROR'
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:46:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:46:54 [DEBUG   ] spawn_process: at 2019-01-18 07:46:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:47:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:47:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:47:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:47:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:47:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:47:04 [DEBUG   ] Finished updating board flags in 1.233 seconds
2019-01-18 07:47:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 07:47:09 [DEBUG   ] Got command BAM from MCS: ref #1204639
2019-01-18 07:47:09 [INFO    ] Finished processing BAM request
2019-01-18 07:47:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204639   8 58501 28029033 A  ERROR'
2019-01-18 07:47:09 [DEBUG   ] Got command BAM from MCS: ref #1204638
2019-01-18 07:47:09 [INFO    ] Finished processing BAM request
2019-01-18 07:47:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204638   8 58501 28029037 A  ERROR'
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:47:09 [DEBUG   ] spawn_process: at 2019-01-18 07:47:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:47:24 [DEBUG   ] Got command BAM from MCS: ref #1204642
2019-01-18 07:47:24 [INFO    ] Finished processing BAM request
2019-01-18 07:47:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204642   8 58501 28044029 A  ERROR'
2019-01-18 07:47:24 [DEBUG   ] Got command BAM from MCS: ref #1204643
2019-01-18 07:47:24 [INFO    ] Finished processing BAM request
2019-01-18 07:47:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204643   8 58501 28044033 A  ERROR'
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:47:24 [DEBUG   ] spawn_process: at 2019-01-18 07:47:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:47:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 07:47:26 [DEBUG   ] Got command RPT from MCS: ref #1204644
2019-01-18 07:47:26 [DEBUG   ] summary = ERROR
2019-01-18 07:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204644  13 58501 28046237 A  ERRORERROR'
2019-01-18 07:47:26 [DEBUG   ] Got command RPT from MCS: ref #1204645
2019-01-18 07:47:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204645  77 58501 28046429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:47:26 [DEBUG   ] Got command RPT from MCS: ref #1204646
2019-01-18 07:47:26 [DEBUG   ] summary = ERROR
2019-01-18 07:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204646  13 58501 28046633 A  ERRORERROR'
2019-01-18 07:47:26 [DEBUG   ] Got command RPT from MCS: ref #1204648
2019-01-18 07:47:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204648  77 58501 28046837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:47:27 [DEBUG   ] Got command RPT from MCS: ref #1204649
2019-01-18 07:47:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204649  12 58501 28047041 A  ERRORB¢ff'
2019-01-18 07:47:39 [DEBUG   ] Got command BAM from MCS: ref #1204655
2019-01-18 07:47:39 [INFO    ] Finished processing BAM request
2019-01-18 07:47:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204655   8 58501 28059037 A  ERROR'
2019-01-18 07:47:39 [DEBUG   ] Got command BAM from MCS: ref #1204654
2019-01-18 07:47:39 [INFO    ] Finished processing BAM request
2019-01-18 07:47:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204654   8 58501 28059045 A  ERROR'
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:47:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:47:39 [DEBUG   ] spawn_process: at 2019-01-18 07:47:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:47:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 07:47:54 [DEBUG   ] Got command BAM from MCS: ref #1204657
2019-01-18 07:47:54 [INFO    ] Finished processing BAM request
2019-01-18 07:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204657   8 58501 28074025 A  ERROR'
2019-01-18 07:47:54 [DEBUG   ] Got command BAM from MCS: ref #1204656
2019-01-18 07:47:54 [INFO    ] Finished processing BAM request
2019-01-18 07:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204656   8 58501 28074029 A  ERROR'
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:47:54 [DEBUG   ] spawn_process: at 2019-01-18 07:47:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:48:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:48:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:48:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:48:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:48:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:48:04 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-01-18 07:48:05 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2019-01-18 07:48:09 [DEBUG   ] Got command BAM from MCS: ref #1204658
2019-01-18 07:48:09 [INFO    ] Finished processing BAM request
2019-01-18 07:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204658   8 58501 28089033 A  ERROR'
2019-01-18 07:48:09 [DEBUG   ] Got command BAM from MCS: ref #1204659
2019-01-18 07:48:09 [INFO    ] Finished processing BAM request
2019-01-18 07:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204659   8 58501 28089037 A  ERROR'
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:48:09 [DEBUG   ] spawn_process: at 2019-01-18 07:48:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:48:24 [DEBUG   ] Got command BAM from MCS: ref #1204660
2019-01-18 07:48:24 [INFO    ] Finished processing BAM request
2019-01-18 07:48:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204660   8 58501 28104033 A  ERROR'
2019-01-18 07:48:24 [DEBUG   ] Got command BAM from MCS: ref #1204661
2019-01-18 07:48:24 [INFO    ] Finished processing BAM request
2019-01-18 07:48:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204661   8 58501 28104037 A  ERROR'
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:48:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:48:24 [DEBUG   ] spawn_process: at 2019-01-18 07:48:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:48:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:48:39 [DEBUG   ] Got command BAM from MCS: ref #1204667
2019-01-18 07:48:39 [INFO    ] Finished processing BAM request
2019-01-18 07:48:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204667   8 58501 28119033 A  ERROR'
2019-01-18 07:48:39 [DEBUG   ] Got command BAM from MCS: ref #1204666
2019-01-18 07:48:39 [INFO    ] Finished processing BAM request
2019-01-18 07:48:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204666   8 58501 28119037 A  ERROR'
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:48:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:48:39 [DEBUG   ] spawn_process: at 2019-01-18 07:48:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:48:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:48:54 [DEBUG   ] Got command BAM from MCS: ref #1204669
2019-01-18 07:48:54 [INFO    ] Finished processing BAM request
2019-01-18 07:48:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204669   8 58501 28134033 A  ERROR'
2019-01-18 07:48:54 [DEBUG   ] Got command BAM from MCS: ref #1204668
2019-01-18 07:48:54 [INFO    ] Finished processing BAM request
2019-01-18 07:48:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204668   8 58501 28134037 A  ERROR'
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:48:54 [DEBUG   ] spawn_process: at 2019-01-18 07:48:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:49:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:49:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:49:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:49:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:49:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:49:04 [DEBUG   ] Finished updating board flags in 1.180 seconds
2019-01-18 07:49:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:49:09 [DEBUG   ] Got command BAM from MCS: ref #1204671
2019-01-18 07:49:09 [INFO    ] Finished processing BAM request
2019-01-18 07:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204671   8 58501 28149025 A  ERROR'
2019-01-18 07:49:09 [DEBUG   ] Got command BAM from MCS: ref #1204670
2019-01-18 07:49:09 [INFO    ] Finished processing BAM request
2019-01-18 07:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204670   8 58501 28149029 A  ERROR'
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:49:09 [DEBUG   ] spawn_process: at 2019-01-18 07:49:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:49:24 [DEBUG   ] Got command BAM from MCS: ref #1204672
2019-01-18 07:49:24 [INFO    ] Finished processing BAM request
2019-01-18 07:49:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204672   8 58501 28164025 A  ERROR'
2019-01-18 07:49:24 [DEBUG   ] Got command BAM from MCS: ref #1204673
2019-01-18 07:49:24 [INFO    ] Finished processing BAM request
2019-01-18 07:49:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204673   8 58501 28164029 A  ERROR'
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:49:24 [DEBUG   ] spawn_process: at 2019-01-18 07:49:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:49:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 07:49:39 [DEBUG   ] Got command BAM from MCS: ref #1204674
2019-01-18 07:49:39 [INFO    ] Finished processing BAM request
2019-01-18 07:49:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204674   8 58501 28179033 A  ERROR'
2019-01-18 07:49:39 [DEBUG   ] Got command BAM from MCS: ref #1204675
2019-01-18 07:49:39 [INFO    ] Finished processing BAM request
2019-01-18 07:49:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204675   8 58501 28179037 A  ERROR'
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:49:39 [DEBUG   ] spawn_process: at 2019-01-18 07:49:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:49:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 07:49:54 [DEBUG   ] Got command BAM from MCS: ref #1204676
2019-01-18 07:49:54 [INFO    ] Finished processing BAM request
2019-01-18 07:49:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204676   8 58501 28194029 A  ERROR'
2019-01-18 07:49:54 [DEBUG   ] Got command BAM from MCS: ref #1204677
2019-01-18 07:49:54 [INFO    ] Finished processing BAM request
2019-01-18 07:49:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204677   8 58501 28194033 A  ERROR'
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:49:54 [DEBUG   ] spawn_process: at 2019-01-18 07:49:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:50:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 07:50:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:50:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:50:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:50:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:50:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:50:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:50:04 [DEBUG   ] Finished updating board flags in 1.002 seconds
2019-01-18 07:50:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 07:50:10 [DEBUG   ] Got command BAM from MCS: ref #1204678
2019-01-18 07:50:10 [INFO    ] Finished processing BAM request
2019-01-18 07:50:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204678   8 58501 28210025 A  ERROR'
2019-01-18 07:50:10 [DEBUG   ] Got command BAM from MCS: ref #1204679
2019-01-18 07:50:10 [INFO    ] Finished processing BAM request
2019-01-18 07:50:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204679   8 58501 28210029 A  ERROR'
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:50:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:50:10 [DEBUG   ] spawn_process: at 2019-01-18 07:50:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:50:26 [DEBUG   ] Got command BAM from MCS: ref #1204680
2019-01-18 07:50:26 [INFO    ] Finished processing BAM request
2019-01-18 07:50:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204680   8 58501 28226033 A  ERROR'
2019-01-18 07:50:26 [DEBUG   ] Got command BAM from MCS: ref #1204681
2019-01-18 07:50:26 [INFO    ] Finished processing BAM request
2019-01-18 07:50:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204681   8 58501 28226037 A  ERROR'
2019-01-18 07:50:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:50:26 [DEBUG   ] spawn_process: at 2019-01-18 07:50:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:50:42 [DEBUG   ] Got command BAM from MCS: ref #1204682
2019-01-18 07:50:42 [INFO    ] Finished processing BAM request
2019-01-18 07:50:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204682   8 58501 28242029 A  ERROR'
2019-01-18 07:50:42 [DEBUG   ] Got command BAM from MCS: ref #1204683
2019-01-18 07:50:42 [INFO    ] Finished processing BAM request
2019-01-18 07:50:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204683   8 58501 28242033 A  ERROR'
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:50:42 [DEBUG   ] spawn_process: at 2019-01-18 07:50:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:50:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:50:58 [DEBUG   ] Got command BAM from MCS: ref #1204685
2019-01-18 07:50:58 [INFO    ] Finished processing BAM request
2019-01-18 07:50:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204685   8 58501 28258025 A  ERROR'
2019-01-18 07:50:58 [DEBUG   ] Got command BAM from MCS: ref #1204684
2019-01-18 07:50:58 [INFO    ] Finished processing BAM request
2019-01-18 07:50:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204684   8 58501 28258029 A  ERROR'
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:50:58 [DEBUG   ] spawn_process: at 2019-01-18 07:50:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:51:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:51:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:51:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:51:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:51:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:51:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:51:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:51:04 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-01-18 07:51:05 [DEBUG   ] Got command RPT from MCS: ref #1204686
2019-01-18 07:51:05 [DEBUG   ] summary = ERROR
2019-01-18 07:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204686  13 58501 28265902 A  ERRORERROR'
2019-01-18 07:51:05 [DEBUG   ] Got command RPT from MCS: ref #1204687
2019-01-18 07:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204687  77 58501 28265902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:51:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:51:14 [DEBUG   ] Got command BAM from MCS: ref #1204703
2019-01-18 07:51:14 [INFO    ] Finished processing BAM request
2019-01-18 07:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204703   8 58501 28274029 A  ERROR'
2019-01-18 07:51:14 [DEBUG   ] Got command BAM from MCS: ref #1204704
2019-01-18 07:51:14 [INFO    ] Finished processing BAM request
2019-01-18 07:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204704   8 58501 28274033 A  ERROR'
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:51:14 [DEBUG   ] spawn_process: at 2019-01-18 07:51:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:51:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:51:30 [DEBUG   ] Got command BAM from MCS: ref #1204706
2019-01-18 07:51:30 [INFO    ] Finished processing BAM request
2019-01-18 07:51:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204706   8 58501 28290025 A  ERROR'
2019-01-18 07:51:30 [DEBUG   ] Got command BAM from MCS: ref #1204705
2019-01-18 07:51:30 [INFO    ] Finished processing BAM request
2019-01-18 07:51:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204705   8 58501 28290029 A  ERROR'
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:51:30 [DEBUG   ] spawn_process: at 2019-01-18 07:51:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:51:46 [DEBUG   ] Got command BAM from MCS: ref #1204711
2019-01-18 07:51:46 [INFO    ] Finished processing BAM request
2019-01-18 07:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204711   8 58501 28306033 A  ERROR'
2019-01-18 07:51:46 [DEBUG   ] Got command BAM from MCS: ref #1204712
2019-01-18 07:51:46 [INFO    ] Finished processing BAM request
2019-01-18 07:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204712   8 58501 28306037 A  ERROR'
2019-01-18 07:51:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:51:46 [DEBUG   ] spawn_process: at 2019-01-18 07:51:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:52:02 [DEBUG   ] Got command BAM from MCS: ref #1204713
2019-01-18 07:52:02 [INFO    ] Finished processing BAM request
2019-01-18 07:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204713   8 58501 28322029 A  ERROR'
2019-01-18 07:52:02 [DEBUG   ] Got command BAM from MCS: ref #1204714
2019-01-18 07:52:02 [INFO    ] Finished processing BAM request
2019-01-18 07:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204714   8 58501 28322033 A  ERROR'
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:52:02 [DEBUG   ] spawn_process: at 2019-01-18 07:52:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:52:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:52:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:52:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:52:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:52:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:52:04 [DEBUG   ] Finished updating board flags in 1.268 seconds
2019-01-18 07:52:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:52:18 [DEBUG   ] Got command BAM from MCS: ref #1204716
2019-01-18 07:52:18 [INFO    ] Finished processing BAM request
2019-01-18 07:52:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204716   8 58501 28338029 A  ERROR'
2019-01-18 07:52:18 [DEBUG   ] Got command BAM from MCS: ref #1204715
2019-01-18 07:52:18 [INFO    ] Finished processing BAM request
2019-01-18 07:52:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204715   8 58501 28338033 A  ERROR'
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:52:18 [DEBUG   ] spawn_process: at 2019-01-18 07:52:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:52:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:52:26 [DEBUG   ] Got command RPT from MCS: ref #1204717
2019-01-18 07:52:26 [DEBUG   ] summary = ERROR
2019-01-18 07:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204717  13 58501 28346325 A  ERRORERROR'
2019-01-18 07:52:26 [DEBUG   ] Got command RPT from MCS: ref #1204718
2019-01-18 07:52:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204718  77 58501 28346517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:52:26 [DEBUG   ] Got command RPT from MCS: ref #1204719
2019-01-18 07:52:26 [DEBUG   ] summary = ERROR
2019-01-18 07:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204719  13 58501 28346721 A  ERRORERROR'
2019-01-18 07:52:26 [DEBUG   ] Got command RPT from MCS: ref #1204720
2019-01-18 07:52:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204720  77 58501 28346925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:52:27 [DEBUG   ] Got command RPT from MCS: ref #1204721
2019-01-18 07:52:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204721  12 58501 28347129 A  ERRORB£ff'
2019-01-18 07:52:34 [DEBUG   ] Got command BAM from MCS: ref #1204722
2019-01-18 07:52:34 [INFO    ] Finished processing BAM request
2019-01-18 07:52:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204722   8 58501 28354033 A  ERROR'
2019-01-18 07:52:34 [DEBUG   ] Got command BAM from MCS: ref #1204723
2019-01-18 07:52:34 [INFO    ] Finished processing BAM request
2019-01-18 07:52:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204723   8 58501 28354037 A  ERROR'
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:52:34 [DEBUG   ] spawn_process: at 2019-01-18 07:52:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:52:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:52:50 [DEBUG   ] Got command BAM from MCS: ref #1204725
2019-01-18 07:52:50 [INFO    ] Finished processing BAM request
2019-01-18 07:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204725   8 58501 28370029 A  ERROR'
2019-01-18 07:52:50 [DEBUG   ] Got command BAM from MCS: ref #1204724
2019-01-18 07:52:50 [INFO    ] Finished processing BAM request
2019-01-18 07:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204724   8 58501 28370033 A  ERROR'
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:52:50 [DEBUG   ] spawn_process: at 2019-01-18 07:52:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 07:53:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:53:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:53:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:53:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:53:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:53:04 [DEBUG   ] Finished updating board flags in 1.227 seconds
2019-01-18 07:53:06 [DEBUG   ] Got command BAM from MCS: ref #1204726
2019-01-18 07:53:06 [INFO    ] Finished processing BAM request
2019-01-18 07:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204726   8 58501 28386029 A  ERROR'
2019-01-18 07:53:06 [DEBUG   ] Got command BAM from MCS: ref #1204727
2019-01-18 07:53:06 [INFO    ] Finished processing BAM request
2019-01-18 07:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204727   8 58501 28386033 A  ERROR'
2019-01-18 07:53:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:53:06 [DEBUG   ] spawn_process: at 2019-01-18 07:53:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:53:22 [DEBUG   ] Got command BAM from MCS: ref #1204729
2019-01-18 07:53:22 [INFO    ] Finished processing BAM request
2019-01-18 07:53:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204729   8 58501 28402029 A  ERROR'
2019-01-18 07:53:22 [DEBUG   ] Got command BAM from MCS: ref #1204728
2019-01-18 07:53:22 [INFO    ] Finished processing BAM request
2019-01-18 07:53:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204728   8 58501 28402033 A  ERROR'
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:53:22 [DEBUG   ] spawn_process: at 2019-01-18 07:53:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:53:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:53:38 [DEBUG   ] Got command BAM from MCS: ref #1204730
2019-01-18 07:53:38 [INFO    ] Finished processing BAM request
2019-01-18 07:53:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204730   8 58501 28418025 A  ERROR'
2019-01-18 07:53:38 [DEBUG   ] Got command BAM from MCS: ref #1204731
2019-01-18 07:53:38 [INFO    ] Finished processing BAM request
2019-01-18 07:53:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204731   8 58501 28418029 A  ERROR'
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:53:38 [DEBUG   ] spawn_process: at 2019-01-18 07:53:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:53:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:53:54 [DEBUG   ] Got command BAM from MCS: ref #1204733
2019-01-18 07:53:54 [INFO    ] Finished processing BAM request
2019-01-18 07:53:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204733   8 58501 28434025 A  ERROR'
2019-01-18 07:53:54 [DEBUG   ] Got command BAM from MCS: ref #1204732
2019-01-18 07:53:54 [INFO    ] Finished processing BAM request
2019-01-18 07:53:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204732   8 58501 28434029 A  ERROR'
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:53:54 [DEBUG   ] spawn_process: at 2019-01-18 07:53:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:54:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 07:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:54:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:54:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:54:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:54:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:54:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:54:04 [DEBUG   ] Finished updating board flags in 1.165 seconds
2019-01-18 07:54:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:54:10 [DEBUG   ] Got command BAM from MCS: ref #1204734
2019-01-18 07:54:10 [INFO    ] Finished processing BAM request
2019-01-18 07:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204734   8 58501 28450033 A  ERROR'
2019-01-18 07:54:10 [DEBUG   ] Got command BAM from MCS: ref #1204735
2019-01-18 07:54:10 [INFO    ] Finished processing BAM request
2019-01-18 07:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204735   8 58501 28450037 A  ERROR'
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:54:10 [DEBUG   ] spawn_process: at 2019-01-18 07:54:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:54:26 [DEBUG   ] Got command BAM from MCS: ref #1204737
2019-01-18 07:54:26 [INFO    ] Finished processing BAM request
2019-01-18 07:54:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204737   8 58501 28466033 A  ERROR'
2019-01-18 07:54:26 [DEBUG   ] Got command BAM from MCS: ref #1204736
2019-01-18 07:54:26 [INFO    ] Finished processing BAM request
2019-01-18 07:54:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204736   8 58501 28466037 A  ERROR'
2019-01-18 07:54:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:54:26 [DEBUG   ] spawn_process: at 2019-01-18 07:54:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:54:42 [DEBUG   ] Got command BAM from MCS: ref #1204742
2019-01-18 07:54:42 [INFO    ] Finished processing BAM request
2019-01-18 07:54:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204742   8 58501 28482025 A  ERROR'
2019-01-18 07:54:42 [DEBUG   ] Got command BAM from MCS: ref #1204743
2019-01-18 07:54:42 [INFO    ] Finished processing BAM request
2019-01-18 07:54:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204743   8 58501 28482029 A  ERROR'
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:54:42 [DEBUG   ] spawn_process: at 2019-01-18 07:54:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:54:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:54:58 [DEBUG   ] Got command BAM from MCS: ref #1204745
2019-01-18 07:54:58 [INFO    ] Finished processing BAM request
2019-01-18 07:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204745   8 58501 28498025 A  ERROR'
2019-01-18 07:54:58 [DEBUG   ] Got command BAM from MCS: ref #1204744
2019-01-18 07:54:58 [INFO    ] Finished processing BAM request
2019-01-18 07:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204744   8 58501 28498029 A  ERROR'
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:54:58 [DEBUG   ] spawn_process: at 2019-01-18 07:54:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:55:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:55:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:55:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:55:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:55:04 [WARNING ] (13, 1, 'bot')
2019-01-18 07:55:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:55:04 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-01-18 07:55:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 07:55:14 [DEBUG   ] Got command BAM from MCS: ref #1204747
2019-01-18 07:55:14 [INFO    ] Finished processing BAM request
2019-01-18 07:55:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204747   8 58501 28514025 A  ERROR'
2019-01-18 07:55:14 [DEBUG   ] Got command BAM from MCS: ref #1204746
2019-01-18 07:55:14 [INFO    ] Finished processing BAM request
2019-01-18 07:55:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204746   8 58501 28514029 A  ERROR'
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:55:14 [DEBUG   ] spawn_process: at 2019-01-18 07:55:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:55:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 07:55:30 [DEBUG   ] Got command BAM from MCS: ref #1204749
2019-01-18 07:55:30 [INFO    ] Finished processing BAM request
2019-01-18 07:55:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204749   8 58501 28530029 A  ERROR'
2019-01-18 07:55:30 [DEBUG   ] Got command BAM from MCS: ref #1204748
2019-01-18 07:55:30 [INFO    ] Finished processing BAM request
2019-01-18 07:55:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204748   8 58501 28530033 A  ERROR'
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:55:30 [DEBUG   ] spawn_process: at 2019-01-18 07:55:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:55:46 [DEBUG   ] Got command BAM from MCS: ref #1204751
2019-01-18 07:55:46 [INFO    ] Finished processing BAM request
2019-01-18 07:55:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:55:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204751   8 58501 28546033 A  ERROR'
2019-01-18 07:55:46 [DEBUG   ] Got command BAM from MCS: ref #1204750
2019-01-18 07:55:46 [INFO    ] Finished processing BAM request
2019-01-18 07:55:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:55:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204750   8 58501 28546037 A  ERROR'
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:55:46 [DEBUG   ] spawn_process: at 2019-01-18 07:55:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:55:47 [DEBUG   ] Finished updating ant stats in 1.803 seconds
2019-01-18 07:56:02 [DEBUG   ] Got command BAM from MCS: ref #1204752
2019-01-18 07:56:02 [INFO    ] Finished processing BAM request
2019-01-18 07:56:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204752   8 58501 28562033 A  ERROR'
2019-01-18 07:56:02 [DEBUG   ] Got command BAM from MCS: ref #1204753
2019-01-18 07:56:02 [INFO    ] Finished processing BAM request
2019-01-18 07:56:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204753   8 58501 28562037 A  ERROR'
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:56:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:56:02 [DEBUG   ] spawn_process: at 2019-01-18 07:56:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:56:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 07:56:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:56:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:56:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:56:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:56:05 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-01-18 07:56:05 [DEBUG   ] Got command RPT from MCS: ref #1204754
2019-01-18 07:56:05 [DEBUG   ] summary = ERROR
2019-01-18 07:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204754  13 58501 28565902 A  ERRORERROR'
2019-01-18 07:56:05 [DEBUG   ] Got command RPT from MCS: ref #1204755
2019-01-18 07:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204755  77 58501 28565902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:56:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:56:18 [DEBUG   ] Got command BAM from MCS: ref #1204772
2019-01-18 07:56:18 [INFO    ] Finished processing BAM request
2019-01-18 07:56:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204772   8 58501 28578025 A  ERROR'
2019-01-18 07:56:18 [DEBUG   ] Got command BAM from MCS: ref #1204771
2019-01-18 07:56:18 [INFO    ] Finished processing BAM request
2019-01-18 07:56:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204771   8 58501 28578029 A  ERROR'
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:56:18 [DEBUG   ] spawn_process: at 2019-01-18 07:56:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:56:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:56:34 [DEBUG   ] Got command BAM from MCS: ref #1204773
2019-01-18 07:56:34 [INFO    ] Finished processing BAM request
2019-01-18 07:56:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204773   8 58501 28594025 A  ERROR'
2019-01-18 07:56:34 [DEBUG   ] Got command BAM from MCS: ref #1204774
2019-01-18 07:56:34 [INFO    ] Finished processing BAM request
2019-01-18 07:56:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204774   8 58501 28594029 A  ERROR'
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:56:34 [DEBUG   ] spawn_process: at 2019-01-18 07:56:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:56:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:56:50 [DEBUG   ] Got command BAM from MCS: ref #1204776
2019-01-18 07:56:50 [INFO    ] Finished processing BAM request
2019-01-18 07:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204776   8 58501 28610029 A  ERROR'
2019-01-18 07:56:50 [DEBUG   ] Got command BAM from MCS: ref #1204775
2019-01-18 07:56:50 [INFO    ] Finished processing BAM request
2019-01-18 07:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204775   8 58501 28610033 A  ERROR'
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:56:50 [DEBUG   ] spawn_process: at 2019-01-18 07:56:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 07:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 07:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:57:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:57:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:57:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:57:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:57:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:57:05 [DEBUG   ] Finished updating board flags in 1.205 seconds
2019-01-18 07:57:06 [DEBUG   ] Got command BAM from MCS: ref #1204778
2019-01-18 07:57:06 [INFO    ] Finished processing BAM request
2019-01-18 07:57:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204778   8 58501 28626033 A  ERROR'
2019-01-18 07:57:06 [DEBUG   ] Got command BAM from MCS: ref #1204777
2019-01-18 07:57:06 [INFO    ] Finished processing BAM request
2019-01-18 07:57:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204777   8 58501 28626037 A  ERROR'
2019-01-18 07:57:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:57:06 [DEBUG   ] spawn_process: at 2019-01-18 07:57:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:57:22 [DEBUG   ] Got command BAM from MCS: ref #1204782
2019-01-18 07:57:22 [INFO    ] Finished processing BAM request
2019-01-18 07:57:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204782   8 58501 28642029 A  ERROR'
2019-01-18 07:57:22 [DEBUG   ] Got command BAM from MCS: ref #1204781
2019-01-18 07:57:22 [INFO    ] Finished processing BAM request
2019-01-18 07:57:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204781   8 58501 28642033 A  ERROR'
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:57:22 [DEBUG   ] spawn_process: at 2019-01-18 07:57:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:57:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:57:26 [DEBUG   ] Got command RPT from MCS: ref #1204783
2019-01-18 07:57:26 [DEBUG   ] summary = ERROR
2019-01-18 07:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204783  13 58501 28646405 A  ERRORERROR'
2019-01-18 07:57:26 [DEBUG   ] Got command RPT from MCS: ref #1204784
2019-01-18 07:57:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204784  77 58501 28646609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:57:26 [DEBUG   ] Got command RPT from MCS: ref #1204785
2019-01-18 07:57:26 [DEBUG   ] summary = ERROR
2019-01-18 07:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204785  13 58501 28646801 A  ERRORERROR'
2019-01-18 07:57:27 [DEBUG   ] Got command RPT from MCS: ref #1204787
2019-01-18 07:57:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 07:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204787  77 58501 28647005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 07:57:27 [DEBUG   ] Got command RPT from MCS: ref #1204788
2019-01-18 07:57:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 07:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204788  12 58501 28647209 A  ERRORB£ff'
2019-01-18 07:57:38 [DEBUG   ] Got command BAM from MCS: ref #1204798
2019-01-18 07:57:38 [INFO    ] Finished processing BAM request
2019-01-18 07:57:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204798   8 58501 28658025 A  ERROR'
2019-01-18 07:57:38 [DEBUG   ] Got command BAM from MCS: ref #1204797
2019-01-18 07:57:38 [INFO    ] Finished processing BAM request
2019-01-18 07:57:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204797   8 58501 28658029 A  ERROR'
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:57:38 [DEBUG   ] spawn_process: at 2019-01-18 07:57:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:57:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 07:57:54 [DEBUG   ] Got command BAM from MCS: ref #1204799
2019-01-18 07:57:54 [INFO    ] Finished processing BAM request
2019-01-18 07:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204799   8 58501 28674025 A  ERROR'
2019-01-18 07:57:54 [DEBUG   ] Got command BAM from MCS: ref #1204800
2019-01-18 07:57:54 [INFO    ] Finished processing BAM request
2019-01-18 07:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204800   8 58501 28674029 A  ERROR'
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:57:54 [DEBUG   ] spawn_process: at 2019-01-18 07:57:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:58:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:58:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:58:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:58:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:58:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:58:05 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-18 07:58:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:58:11 [DEBUG   ] Got command BAM from MCS: ref #1204801
2019-01-18 07:58:11 [INFO    ] Finished processing BAM request
2019-01-18 07:58:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204801   8 58501 28691025 A  ERROR'
2019-01-18 07:58:11 [DEBUG   ] Got command BAM from MCS: ref #1204802
2019-01-18 07:58:11 [INFO    ] Finished processing BAM request
2019-01-18 07:58:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204802   8 58501 28691029 A  ERROR'
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:58:11 [DEBUG   ] spawn_process: at 2019-01-18 07:58:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:58:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 07:58:28 [DEBUG   ] Got command BAM from MCS: ref #1204804
2019-01-18 07:58:28 [INFO    ] Finished processing BAM request
2019-01-18 07:58:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204804   8 58501 28708025 A  ERROR'
2019-01-18 07:58:28 [DEBUG   ] Got command BAM from MCS: ref #1204803
2019-01-18 07:58:28 [INFO    ] Finished processing BAM request
2019-01-18 07:58:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204803   8 58501 28708029 A  ERROR'
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 07:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 07:58:28 [DEBUG   ] spawn_process: at 2019-01-18 07:58:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 07:58:45 [DEBUG   ] Got command BAM from MCS: ref #1204806
2019-01-18 07:58:45 [INFO    ] Finished processing BAM request
2019-01-18 07:58:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204806   8 58501 28725025 A  ERROR'
2019-01-18 07:58:45 [DEBUG   ] Got command BAM from MCS: ref #1204805
2019-01-18 07:58:45 [INFO    ] Finished processing BAM request
2019-01-18 07:58:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204805   8 58501 28725029 A  ERROR'
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 07:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 07:58:45 [DEBUG   ] spawn_process: at 2019-01-18 07:58:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 07:58:46 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-18 07:59:02 [DEBUG   ] Got command BAM from MCS: ref #1204807
2019-01-18 07:59:02 [INFO    ] Finished processing BAM request
2019-01-18 07:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204807   8 58501 28742033 A  ERROR'
2019-01-18 07:59:02 [DEBUG   ] Got command BAM from MCS: ref #1204808
2019-01-18 07:59:02 [INFO    ] Finished processing BAM request
2019-01-18 07:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204808   8 58501 28742037 A  ERROR'
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 07:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 07:59:02 [DEBUG   ] spawn_process: at 2019-01-18 07:59:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 07:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 07:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 07:59:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 07:59:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:59:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:59:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:59:05 [WARNING ] (13, 1, 'bot')
2019-01-18 07:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 07:59:05 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-01-18 07:59:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:59:19 [DEBUG   ] Got command BAM from MCS: ref #1204809
2019-01-18 07:59:19 [INFO    ] Finished processing BAM request
2019-01-18 07:59:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204809   8 58501 28759025 A  ERROR'
2019-01-18 07:59:19 [DEBUG   ] Got command BAM from MCS: ref #1204810
2019-01-18 07:59:19 [INFO    ] Finished processing BAM request
2019-01-18 07:59:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204810   8 58501 28759029 A  ERROR'
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:59:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:59:19 [DEBUG   ] spawn_process: at 2019-01-18 07:59:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 07:59:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 07:59:36 [DEBUG   ] Got command BAM from MCS: ref #1204812
2019-01-18 07:59:36 [INFO    ] Finished processing BAM request
2019-01-18 07:59:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204812   8 58501 28776025 A  ERROR'
2019-01-18 07:59:36 [DEBUG   ] Got command BAM from MCS: ref #1204811
2019-01-18 07:59:36 [INFO    ] Finished processing BAM request
2019-01-18 07:59:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204811   8 58501 28776029 A  ERROR'
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 07:59:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 07:59:36 [DEBUG   ] spawn_process: at 2019-01-18 07:59:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 07:59:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 07:59:53 [DEBUG   ] Got command BAM from MCS: ref #1204813
2019-01-18 07:59:53 [INFO    ] Finished processing BAM request
2019-01-18 07:59:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204813   8 58501 28793033 A  ERROR'
2019-01-18 07:59:53 [DEBUG   ] Got command BAM from MCS: ref #1204814
2019-01-18 07:59:53 [INFO    ] Finished processing BAM request
2019-01-18 07:59:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 07:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204814   8 58501 28793037 A  ERROR'
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 07:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 07:59:53 [DEBUG   ] spawn_process: at 2019-01-18 07:59:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 08:00:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:00:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:00:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:00:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:00:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:00:05 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-18 08:00:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:00:10 [DEBUG   ] Got command BAM from MCS: ref #1204816
2019-01-18 08:00:10 [INFO    ] Finished processing BAM request
2019-01-18 08:00:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204816   8 58501 28810025 A  ERROR'
2019-01-18 08:00:10 [DEBUG   ] Got command BAM from MCS: ref #1204815
2019-01-18 08:00:10 [INFO    ] Finished processing BAM request
2019-01-18 08:00:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204815   8 58501 28810029 A  ERROR'
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:00:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:00:10 [DEBUG   ] spawn_process: at 2019-01-18 08:00:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:00:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 08:00:27 [DEBUG   ] Got command BAM from MCS: ref #1204817
2019-01-18 08:00:27 [INFO    ] Finished processing BAM request
2019-01-18 08:00:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204817   8 58501 28827033 A  ERROR'
2019-01-18 08:00:27 [DEBUG   ] Got command BAM from MCS: ref #1204818
2019-01-18 08:00:27 [INFO    ] Finished processing BAM request
2019-01-18 08:00:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204818   8 58501 28827037 A  ERROR'
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:00:27 [DEBUG   ] spawn_process: at 2019-01-18 08:00:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:00:44 [DEBUG   ] Got command BAM from MCS: ref #1204824
2019-01-18 08:00:44 [INFO    ] Finished processing BAM request
2019-01-18 08:00:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204824   8 58501 28844029 A  ERROR'
2019-01-18 08:00:44 [DEBUG   ] Got command BAM from MCS: ref #1204823
2019-01-18 08:00:44 [INFO    ] Finished processing BAM request
2019-01-18 08:00:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204823   8 58501 28844033 A  ERROR'
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:00:44 [DEBUG   ] spawn_process: at 2019-01-18 08:00:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:00:46 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-18 08:01:01 [DEBUG   ] Got command BAM from MCS: ref #1204826
2019-01-18 08:01:01 [INFO    ] Finished processing BAM request
2019-01-18 08:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204826   8 58501 28861029 A  ERROR'
2019-01-18 08:01:01 [DEBUG   ] Got command BAM from MCS: ref #1204825
2019-01-18 08:01:01 [INFO    ] Finished processing BAM request
2019-01-18 08:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204825   8 58501 28861033 A  ERROR'
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:01:01 [DEBUG   ] spawn_process: at 2019-01-18 08:01:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-18 08:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 08:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:01:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:01:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:01:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:01:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:01:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:01:05 [DEBUG   ] Finished updating board flags in 0.980 seconds
2019-01-18 08:01:05 [DEBUG   ] Got command RPT from MCS: ref #1204827
2019-01-18 08:01:05 [DEBUG   ] summary = ERROR
2019-01-18 08:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204827  13 58501 28865902 A  ERRORERROR'
2019-01-18 08:01:05 [DEBUG   ] Got command RPT from MCS: ref #1204828
2019-01-18 08:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204828  77 58501 28865902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:01:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:01:18 [DEBUG   ] Got command BAM from MCS: ref #1204844
2019-01-18 08:01:18 [INFO    ] Finished processing BAM request
2019-01-18 08:01:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204844   8 58501 28878025 A  ERROR'
2019-01-18 08:01:18 [DEBUG   ] Got command BAM from MCS: ref #1204845
2019-01-18 08:01:18 [INFO    ] Finished processing BAM request
2019-01-18 08:01:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204845   8 58501 28878029 A  ERROR'
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:01:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:01:18 [DEBUG   ] spawn_process: at 2019-01-18 08:01:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:01:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:01:35 [DEBUG   ] Got command BAM from MCS: ref #1204846
2019-01-18 08:01:35 [INFO    ] Finished processing BAM request
2019-01-18 08:01:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204846   8 58501 28895029 A  ERROR'
2019-01-18 08:01:35 [DEBUG   ] Got command BAM from MCS: ref #1204847
2019-01-18 08:01:35 [INFO    ] Finished processing BAM request
2019-01-18 08:01:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204847   8 58501 28895033 A  ERROR'
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:01:35 [DEBUG   ] spawn_process: at 2019-01-18 08:01:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:01:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:01:52 [DEBUG   ] Got command BAM from MCS: ref #1204849
2019-01-18 08:01:52 [INFO    ] Finished processing BAM request
2019-01-18 08:01:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204849   8 58501 28912029 A  ERROR'
2019-01-18 08:01:52 [DEBUG   ] Got command BAM from MCS: ref #1204848
2019-01-18 08:01:52 [INFO    ] Finished processing BAM request
2019-01-18 08:01:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204848   8 58501 28912033 A  ERROR'
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:01:52 [DEBUG   ] spawn_process: at 2019-01-18 08:01:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:02:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:02:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:02:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:02:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:02:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:02:05 [DEBUG   ] Finished updating board flags in 1.287 seconds
2019-01-18 08:02:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:02:09 [DEBUG   ] Got command BAM from MCS: ref #1204851
2019-01-18 08:02:09 [INFO    ] Finished processing BAM request
2019-01-18 08:02:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204851   8 58501 28929037 A  ERROR'
2019-01-18 08:02:09 [DEBUG   ] Got command BAM from MCS: ref #1204850
2019-01-18 08:02:09 [INFO    ] Finished processing BAM request
2019-01-18 08:02:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204850   8 58501 28929041 A  ERROR'
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:02:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:02:09 [DEBUG   ] spawn_process: at 2019-01-18 08:02:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:02:26 [DEBUG   ] Got command BAM from MCS: ref #1204852
2019-01-18 08:02:26 [INFO    ] Finished processing BAM request
2019-01-18 08:02:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204852   8 58501 28946025 A  ERROR'
2019-01-18 08:02:26 [DEBUG   ] Got command BAM from MCS: ref #1204853
2019-01-18 08:02:26 [INFO    ] Finished processing BAM request
2019-01-18 08:02:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204853   8 58501 28946029 A  ERROR'
2019-01-18 08:02:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:02:26 [DEBUG   ] Got command RPT from MCS: ref #1204854
2019-01-18 08:02:26 [DEBUG   ] summary = ERROR
2019-01-18 08:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204854  13 58501 28946497 A  ERRORERROR'
2019-01-18 08:02:26 [DEBUG   ] Got command RPT from MCS: ref #1204855
2019-01-18 08:02:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204855  77 58501 28946689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:02:26 [DEBUG   ] Got command RPT from MCS: ref #1204856
2019-01-18 08:02:26 [DEBUG   ] summary = ERROR
2019-01-18 08:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204856  13 58501 28946907 A  ERRORERROR'
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:02:26 [DEBUG   ] spawn_process: at 2019-01-18 08:02:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:02:27 [DEBUG   ] Got command RPT from MCS: ref #1204857
2019-01-18 08:02:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204857  77 58501 28947097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:02:27 [DEBUG   ] Got command RPT from MCS: ref #1204858
2019-01-18 08:02:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204858  12 58501 28947289 A  ERRORB¢ff'
2019-01-18 08:02:43 [DEBUG   ] Got command BAM from MCS: ref #1204859
2019-01-18 08:02:43 [INFO    ] Finished processing BAM request
2019-01-18 08:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204859   8 58501 28963025 A  ERROR'
2019-01-18 08:02:43 [DEBUG   ] Got command BAM from MCS: ref #1204860
2019-01-18 08:02:43 [INFO    ] Finished processing BAM request
2019-01-18 08:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204860   8 58501 28963029 A  ERROR'
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:02:43 [DEBUG   ] spawn_process: at 2019-01-18 08:02:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:02:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:03:00 [DEBUG   ] Got command BAM from MCS: ref #1204862
2019-01-18 08:03:00 [INFO    ] Finished processing BAM request
2019-01-18 08:03:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204862   8 58501 28980025 A  ERROR'
2019-01-18 08:03:00 [DEBUG   ] Got command BAM from MCS: ref #1204861
2019-01-18 08:03:00 [INFO    ] Finished processing BAM request
2019-01-18 08:03:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204861   8 58501 28980029 A  ERROR'
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:03:00 [DEBUG   ] spawn_process: at 2019-01-18 08:03:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 08:03:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:03:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:03:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:03:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:03:05 [WARNING ] (13, 1, 'bot')
2019-01-18 08:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:03:05 [DEBUG   ] Finished updating board flags in 1.164 seconds
2019-01-18 08:03:06 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 08:03:17 [DEBUG   ] Got command BAM from MCS: ref #1204863
2019-01-18 08:03:17 [INFO    ] Finished processing BAM request
2019-01-18 08:03:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204863   8 58501 28997033 A  ERROR'
2019-01-18 08:03:17 [DEBUG   ] Got command BAM from MCS: ref #1204864
2019-01-18 08:03:17 [INFO    ] Finished processing BAM request
2019-01-18 08:03:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204864   8 58501 28997037 A  ERROR'
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:03:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:03:17 [DEBUG   ] spawn_process: at 2019-01-18 08:03:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:03:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 08:03:35 [DEBUG   ] Got command BAM from MCS: ref #1204866
2019-01-18 08:03:35 [INFO    ] Finished processing BAM request
2019-01-18 08:03:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204866   8 58501 29015029 A  ERROR'
2019-01-18 08:03:35 [DEBUG   ] Got command BAM from MCS: ref #1204867
2019-01-18 08:03:35 [INFO    ] Finished processing BAM request
2019-01-18 08:03:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204867   8 58501 29015033 A  ERROR'
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:03:35 [DEBUG   ] spawn_process: at 2019-01-18 08:03:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:03:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:03:53 [DEBUG   ] Got command BAM from MCS: ref #1204871
2019-01-18 08:03:53 [INFO    ] Finished processing BAM request
2019-01-18 08:03:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204871   8 58501 29033026 A  ERROR'
2019-01-18 08:03:53 [DEBUG   ] Got command BAM from MCS: ref #1204872
2019-01-18 08:03:53 [INFO    ] Finished processing BAM request
2019-01-18 08:03:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204872   8 58501 29033030 A  ERROR'
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:03:53 [DEBUG   ] spawn_process: at 2019-01-18 08:03:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 08:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:04:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:04:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:04:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:04:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:04:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:04:06 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-18 08:04:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:04:11 [DEBUG   ] Got command BAM from MCS: ref #1204873
2019-01-18 08:04:11 [INFO    ] Finished processing BAM request
2019-01-18 08:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204873   8 58501 29051033 A  ERROR'
2019-01-18 08:04:11 [DEBUG   ] Got command BAM from MCS: ref #1204874
2019-01-18 08:04:11 [INFO    ] Finished processing BAM request
2019-01-18 08:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204874   8 58501 29051037 A  ERROR'
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:04:11 [DEBUG   ] spawn_process: at 2019-01-18 08:04:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:04:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:04:29 [DEBUG   ] Got command BAM from MCS: ref #1204875
2019-01-18 08:04:29 [INFO    ] Finished processing BAM request
2019-01-18 08:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204875   8 58501 29069033 A  ERROR'
2019-01-18 08:04:29 [DEBUG   ] Got command BAM from MCS: ref #1204876
2019-01-18 08:04:29 [INFO    ] Finished processing BAM request
2019-01-18 08:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204876   8 58501 29069037 A  ERROR'
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:04:29 [DEBUG   ] spawn_process: at 2019-01-18 08:04:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:04:47 [DEBUG   ] Got command BAM from MCS: ref #1204878
2019-01-18 08:04:47 [INFO    ] Finished processing BAM request
2019-01-18 08:04:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:04:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204878   8 58501 29087029 A  ERROR'
2019-01-18 08:04:47 [DEBUG   ] Got command BAM from MCS: ref #1204877
2019-01-18 08:04:47 [INFO    ] Finished processing BAM request
2019-01-18 08:04:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:04:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204877   8 58501 29087033 A  ERROR'
2019-01-18 08:04:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:04:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:04:47 [DEBUG   ] spawn_process: at 2019-01-18 08:04:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:05:05 [DEBUG   ] Got command BAM from MCS: ref #1204879
2019-01-18 08:05:05 [INFO    ] Finished processing BAM request
2019-01-18 08:05:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204879   8 58501 29105025 A  ERROR'
2019-01-18 08:05:05 [DEBUG   ] Got command BAM from MCS: ref #1204880
2019-01-18 08:05:05 [INFO    ] Finished processing BAM request
2019-01-18 08:05:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204880   8 58501 29105029 A  ERROR'
2019-01-18 08:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:05:05 [DEBUG   ] spawn_process: at 2019-01-18 08:05:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:05:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:05:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:05:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:05:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:05:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:05:06 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-18 08:05:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 08:05:23 [DEBUG   ] Got command BAM from MCS: ref #1204881
2019-01-18 08:05:23 [INFO    ] Finished processing BAM request
2019-01-18 08:05:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204881   8 58501 29123025 A  ERROR'
2019-01-18 08:05:23 [DEBUG   ] Got command BAM from MCS: ref #1204882
2019-01-18 08:05:23 [INFO    ] Finished processing BAM request
2019-01-18 08:05:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204882   8 58501 29123029 A  ERROR'
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:05:23 [DEBUG   ] spawn_process: at 2019-01-18 08:05:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:05:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:05:41 [DEBUG   ] Got command BAM from MCS: ref #1204884
2019-01-18 08:05:41 [INFO    ] Finished processing BAM request
2019-01-18 08:05:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204884   8 58501 29141025 A  ERROR'
2019-01-18 08:05:41 [DEBUG   ] Got command BAM from MCS: ref #1204883
2019-01-18 08:05:41 [INFO    ] Finished processing BAM request
2019-01-18 08:05:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204883   8 58501 29141029 A  ERROR'
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:05:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:05:41 [DEBUG   ] spawn_process: at 2019-01-18 08:05:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:05:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:05:59 [DEBUG   ] Got command BAM from MCS: ref #1204886
2019-01-18 08:05:59 [INFO    ] Finished processing BAM request
2019-01-18 08:05:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204886   8 58501 29159025 A  ERROR'
2019-01-18 08:05:59 [DEBUG   ] Got command BAM from MCS: ref #1204885
2019-01-18 08:05:59 [INFO    ] Finished processing BAM request
2019-01-18 08:05:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204885   8 58501 29159029 A  ERROR'
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:05:59 [DEBUG   ] spawn_process: at 2019-01-18 08:05:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-18 08:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 08:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:06:05 [DEBUG   ] Got command RPT from MCS: ref #1204887
2019-01-18 08:06:05 [DEBUG   ] summary = ERROR
2019-01-18 08:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204887  13 58501 29165902 A  ERRORERROR'
2019-01-18 08:06:05 [DEBUG   ] Got command RPT from MCS: ref #1204888
2019-01-18 08:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204888  77 58501 29165902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:06:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:06:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:06:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:06:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:06:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:06:06 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-18 08:06:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 08:06:17 [DEBUG   ] Got command BAM from MCS: ref #1204904
2019-01-18 08:06:17 [INFO    ] Finished processing BAM request
2019-01-18 08:06:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204904   8 58501 29177029 A  ERROR'
2019-01-18 08:06:17 [DEBUG   ] Got command BAM from MCS: ref #1204905
2019-01-18 08:06:17 [INFO    ] Finished processing BAM request
2019-01-18 08:06:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204905   8 58501 29177033 A  ERROR'
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:06:17 [DEBUG   ] spawn_process: at 2019-01-18 08:06:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:06:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:06:35 [DEBUG   ] Got command BAM from MCS: ref #1204907
2019-01-18 08:06:35 [INFO    ] Finished processing BAM request
2019-01-18 08:06:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204907   8 58501 29195029 A  ERROR'
2019-01-18 08:06:35 [DEBUG   ] Got command BAM from MCS: ref #1204908
2019-01-18 08:06:35 [INFO    ] Finished processing BAM request
2019-01-18 08:06:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204908   8 58501 29195033 A  ERROR'
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:06:35 [DEBUG   ] spawn_process: at 2019-01-18 08:06:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:06:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:06:53 [DEBUG   ] Got command BAM from MCS: ref #1204913
2019-01-18 08:06:53 [INFO    ] Finished processing BAM request
2019-01-18 08:06:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204913   8 58501 29213033 A  ERROR'
2019-01-18 08:06:53 [DEBUG   ] Got command BAM from MCS: ref #1204912
2019-01-18 08:06:53 [INFO    ] Finished processing BAM request
2019-01-18 08:06:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204912   8 58501 29213037 A  ERROR'
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:06:53 [DEBUG   ] spawn_process: at 2019-01-18 08:06:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 08:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:07:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:07:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 08:07:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:07:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:07:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:07:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:07:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:07:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:07:07 [DEBUG   ] Finished updating board flags in 2.300 seconds
2019-01-18 08:07:11 [DEBUG   ] Got command BAM from MCS: ref #1204915
2019-01-18 08:07:11 [INFO    ] Finished processing BAM request
2019-01-18 08:07:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204915   8 58501 29231033 A  ERROR'
2019-01-18 08:07:11 [DEBUG   ] Got command BAM from MCS: ref #1204914
2019-01-18 08:07:11 [INFO    ] Finished processing BAM request
2019-01-18 08:07:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204914   8 58501 29231037 A  ERROR'
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:07:11 [DEBUG   ] spawn_process: at 2019-01-18 08:07:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:07:26 [DEBUG   ] Got command RPT from MCS: ref #1204918
2019-01-18 08:07:26 [DEBUG   ] summary = ERROR
2019-01-18 08:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204918  13 58501 29246577 A  ERRORERROR'
2019-01-18 08:07:26 [DEBUG   ] Got command RPT from MCS: ref #1204919
2019-01-18 08:07:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204919  77 58501 29246781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:07:26 [DEBUG   ] Got command RPT from MCS: ref #1204920
2019-01-18 08:07:26 [DEBUG   ] summary = ERROR
2019-01-18 08:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204920  13 58501 29246973 A  ERRORERROR'
2019-01-18 08:07:27 [DEBUG   ] Got command RPT from MCS: ref #1204922
2019-01-18 08:07:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204922  77 58501 29247177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:07:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 08:07:27 [DEBUG   ] Got command RPT from MCS: ref #1204924
2019-01-18 08:07:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204924  12 58501 29247381 A  ERRORB£ff'
2019-01-18 08:07:29 [DEBUG   ] Got command BAM from MCS: ref #1204928
2019-01-18 08:07:29 [INFO    ] Finished processing BAM request
2019-01-18 08:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204928   8 58501 29249029 A  ERROR'
2019-01-18 08:07:29 [DEBUG   ] Got command BAM from MCS: ref #1204929
2019-01-18 08:07:29 [INFO    ] Finished processing BAM request
2019-01-18 08:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204929   8 58501 29249033 A  ERROR'
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:07:29 [DEBUG   ] spawn_process: at 2019-01-18 08:07:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:07:47 [DEBUG   ] Got command BAM from MCS: ref #1204930
2019-01-18 08:07:47 [INFO    ] Finished processing BAM request
2019-01-18 08:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204930   8 58501 29267025 A  ERROR'
2019-01-18 08:07:47 [DEBUG   ] Got command BAM from MCS: ref #1204931
2019-01-18 08:07:47 [INFO    ] Finished processing BAM request
2019-01-18 08:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204931   8 58501 29267029 A  ERROR'
2019-01-18 08:07:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:07:47 [DEBUG   ] spawn_process: at 2019-01-18 08:07:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 08:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 08:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 08:08:06 [DEBUG   ] Got command BAM from MCS: ref #1204932
2019-01-18 08:08:06 [INFO    ] Finished processing BAM request
2019-01-18 08:08:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204932   8 58501 29286026 A  ERROR'
2019-01-18 08:08:06 [DEBUG   ] Got command BAM from MCS: ref #1204933
2019-01-18 08:08:06 [INFO    ] Finished processing BAM request
2019-01-18 08:08:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204933   8 58501 29286033 A  ERROR'
2019-01-18 08:08:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:08:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:08:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:08:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:08:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:08:06 [DEBUG   ] Finished updating board flags in 1.306 seconds
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:08:06 [DEBUG   ] spawn_process: at 2019-01-18 08:08:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:08:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 08:08:25 [DEBUG   ] Got command BAM from MCS: ref #1204934
2019-01-18 08:08:25 [INFO    ] Finished processing BAM request
2019-01-18 08:08:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204934   8 58501 29305025 A  ERROR'
2019-01-18 08:08:25 [DEBUG   ] Got command BAM from MCS: ref #1204935
2019-01-18 08:08:25 [INFO    ] Finished processing BAM request
2019-01-18 08:08:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204935   8 58501 29305029 A  ERROR'
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:08:25 [DEBUG   ] spawn_process: at 2019-01-18 08:08:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:08:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:08:44 [DEBUG   ] Got command BAM from MCS: ref #1204937
2019-01-18 08:08:44 [INFO    ] Finished processing BAM request
2019-01-18 08:08:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204937   8 58501 29324029 A  ERROR'
2019-01-18 08:08:44 [DEBUG   ] Got command BAM from MCS: ref #1204936
2019-01-18 08:08:44 [INFO    ] Finished processing BAM request
2019-01-18 08:08:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204936   8 58501 29324033 A  ERROR'
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:08:44 [DEBUG   ] spawn_process: at 2019-01-18 08:08:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:08:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 08:09:03 [DEBUG   ] Got command BAM from MCS: ref #1204938
2019-01-18 08:09:03 [INFO    ] Finished processing BAM request
2019-01-18 08:09:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:09:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204938   8 58501 29343029 A  ERROR'
2019-01-18 08:09:03 [DEBUG   ] Got command BAM from MCS: ref #1204939
2019-01-18 08:09:03 [INFO    ] Finished processing BAM request
2019-01-18 08:09:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:09:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204939   8 58501 29343033 A  ERROR'
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:09:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:09:03 [DEBUG   ] spawn_process: at 2019-01-18 08:09:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-18 08:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 08:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:09:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:09:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:09:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:09:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:09:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:09:06 [DEBUG   ] Finished updating board flags in 1.148 seconds
2019-01-18 08:09:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 08:09:22 [DEBUG   ] Got command BAM from MCS: ref #1204940
2019-01-18 08:09:22 [INFO    ] Finished processing BAM request
2019-01-18 08:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204940   8 58501 29362033 A  ERROR'
2019-01-18 08:09:22 [DEBUG   ] Got command BAM from MCS: ref #1204941
2019-01-18 08:09:22 [INFO    ] Finished processing BAM request
2019-01-18 08:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204941   8 58501 29362037 A  ERROR'
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:09:22 [DEBUG   ] spawn_process: at 2019-01-18 08:09:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:09:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:09:41 [DEBUG   ] Got command BAM from MCS: ref #1204947
2019-01-18 08:09:41 [INFO    ] Finished processing BAM request
2019-01-18 08:09:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204947   8 58501 29381026 A  ERROR'
2019-01-18 08:09:41 [DEBUG   ] Got command BAM from MCS: ref #1204946
2019-01-18 08:09:41 [INFO    ] Finished processing BAM request
2019-01-18 08:09:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204946   8 58501 29381030 A  ERROR'
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:09:41 [DEBUG   ] spawn_process: at 2019-01-18 08:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:09:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:10:00 [DEBUG   ] Got command BAM from MCS: ref #1204948
2019-01-18 08:10:00 [INFO    ] Finished processing BAM request
2019-01-18 08:10:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204948   8 58501 29400030 A  ERROR'
2019-01-18 08:10:00 [DEBUG   ] Got command BAM from MCS: ref #1204949
2019-01-18 08:10:00 [INFO    ] Finished processing BAM request
2019-01-18 08:10:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204949   8 58501 29400034 A  ERROR'
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:10:00 [DEBUG   ] spawn_process: at 2019-01-18 08:10:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:10:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:10:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:10:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:10:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:10:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:10:06 [DEBUG   ] Finished updating board flags in 1.028 seconds
2019-01-18 08:10:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:10:19 [DEBUG   ] Got command BAM from MCS: ref #1204950
2019-01-18 08:10:19 [INFO    ] Finished processing BAM request
2019-01-18 08:10:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204950   8 58501 29419034 A  ERROR'
2019-01-18 08:10:19 [DEBUG   ] Got command BAM from MCS: ref #1204951
2019-01-18 08:10:19 [INFO    ] Finished processing BAM request
2019-01-18 08:10:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204951   8 58501 29419038 A  ERROR'
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:10:19 [DEBUG   ] spawn_process: at 2019-01-18 08:10:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:10:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:10:38 [DEBUG   ] Got command BAM from MCS: ref #1204953
2019-01-18 08:10:38 [INFO    ] Finished processing BAM request
2019-01-18 08:10:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204953   8 58501 29438025 A  ERROR'
2019-01-18 08:10:38 [DEBUG   ] Got command BAM from MCS: ref #1204952
2019-01-18 08:10:38 [INFO    ] Finished processing BAM request
2019-01-18 08:10:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204952   8 58501 29438029 A  ERROR'
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:10:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:10:38 [DEBUG   ] spawn_process: at 2019-01-18 08:10:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:10:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:10:57 [DEBUG   ] Got command BAM from MCS: ref #1204955
2019-01-18 08:10:57 [INFO    ] Finished processing BAM request
2019-01-18 08:10:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204955   8 58501 29457029 A  ERROR'
2019-01-18 08:10:57 [DEBUG   ] Got command BAM from MCS: ref #1204954
2019-01-18 08:10:57 [INFO    ] Finished processing BAM request
2019-01-18 08:10:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204954   8 58501 29457033 A  ERROR'
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:10:57 [DEBUG   ] spawn_process: at 2019-01-18 08:10:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:11:05 [DEBUG   ] Got command RPT from MCS: ref #1204956
2019-01-18 08:11:05 [DEBUG   ] summary = ERROR
2019-01-18 08:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204956  13 58501 29465906 A  ERRORERROR'
2019-01-18 08:11:05 [DEBUG   ] Got command RPT from MCS: ref #1204957
2019-01-18 08:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204957  77 58501 29465906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:11:07 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2019-01-18 08:11:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:11:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:11:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:11:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:11:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:11:07 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-01-18 08:11:16 [DEBUG   ] Got command BAM from MCS: ref #1204974
2019-01-18 08:11:16 [INFO    ] Finished processing BAM request
2019-01-18 08:11:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204974   8 58501 29476025 A  ERROR'
2019-01-18 08:11:16 [DEBUG   ] Got command BAM from MCS: ref #1204973
2019-01-18 08:11:16 [INFO    ] Finished processing BAM request
2019-01-18 08:11:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204973   8 58501 29476029 A  ERROR'
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:11:16 [DEBUG   ] spawn_process: at 2019-01-18 08:11:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:11:27 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2019-01-18 08:11:35 [DEBUG   ] Got command BAM from MCS: ref #1204976
2019-01-18 08:11:35 [INFO    ] Finished processing BAM request
2019-01-18 08:11:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204976   8 58501 29495029 A  ERROR'
2019-01-18 08:11:35 [DEBUG   ] Got command BAM from MCS: ref #1204975
2019-01-18 08:11:35 [INFO    ] Finished processing BAM request
2019-01-18 08:11:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204975   8 58501 29495033 A  ERROR'
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:11:35 [DEBUG   ] spawn_process: at 2019-01-18 08:11:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:11:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:11:55 [DEBUG   ] Got command BAM from MCS: ref #1204978
2019-01-18 08:11:55 [INFO    ] Finished processing BAM request
2019-01-18 08:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204978   8 58501 29515029 A  ERROR'
2019-01-18 08:11:55 [DEBUG   ] Got command BAM from MCS: ref #1204977
2019-01-18 08:11:55 [INFO    ] Finished processing BAM request
2019-01-18 08:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204977   8 58501 29515033 A  ERROR'
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:11:55 [DEBUG   ] spawn_process: at 2019-01-18 08:11:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:12:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:12:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:12:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:12:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:12:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:12:06 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-18 08:12:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:12:15 [DEBUG   ] Got command BAM from MCS: ref #1204980
2019-01-18 08:12:15 [INFO    ] Finished processing BAM request
2019-01-18 08:12:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204980   8 58501 29535030 A  ERROR'
2019-01-18 08:12:15 [DEBUG   ] Got command BAM from MCS: ref #1204979
2019-01-18 08:12:15 [INFO    ] Finished processing BAM request
2019-01-18 08:12:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:12:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204979   8 58501 29535034 A  ERROR'
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:12:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:12:15 [DEBUG   ] spawn_process: at 2019-01-18 08:12:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:12:26 [DEBUG   ] Got command RPT from MCS: ref #1204981
2019-01-18 08:12:26 [DEBUG   ] summary = ERROR
2019-01-18 08:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204981  13 58501 29546662 A  ERRORERROR'
2019-01-18 08:12:26 [DEBUG   ] Got command RPT from MCS: ref #1204982
2019-01-18 08:12:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204982  77 58501 29546866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:12:27 [DEBUG   ] Got command RPT from MCS: ref #1204983
2019-01-18 08:12:27 [DEBUG   ] summary = ERROR
2019-01-18 08:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204983  13 58501 29547070 A  ERRORERROR'
2019-01-18 08:12:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 08:12:27 [DEBUG   ] Got command RPT from MCS: ref #1204984
2019-01-18 08:12:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204984  77 58501 29547262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:12:27 [DEBUG   ] Got command RPT from MCS: ref #1204985
2019-01-18 08:12:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1204985  12 58501 29547465 A  ERRORB£ff'
2019-01-18 08:12:35 [DEBUG   ] Got command BAM from MCS: ref #1204986
2019-01-18 08:12:35 [INFO    ] Finished processing BAM request
2019-01-18 08:12:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204986   8 58501 29555030 A  ERROR'
2019-01-18 08:12:35 [DEBUG   ] Got command BAM from MCS: ref #1204987
2019-01-18 08:12:35 [INFO    ] Finished processing BAM request
2019-01-18 08:12:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204987   8 58501 29555034 A  ERROR'
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:12:35 [DEBUG   ] spawn_process: at 2019-01-18 08:12:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:12:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:12:55 [DEBUG   ] Got command BAM from MCS: ref #1204993
2019-01-18 08:12:55 [INFO    ] Finished processing BAM request
2019-01-18 08:12:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:12:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204993   8 58501 29575030 A  ERROR'
2019-01-18 08:12:55 [DEBUG   ] Got command BAM from MCS: ref #1204992
2019-01-18 08:12:55 [INFO    ] Finished processing BAM request
2019-01-18 08:12:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:12:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204992   8 58501 29575034 A  ERROR'
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:12:55 [DEBUG   ] spawn_process: at 2019-01-18 08:12:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-18 08:13:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:13:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:13:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:13:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:13:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:13:06 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-18 08:13:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 08:13:15 [DEBUG   ] Got command BAM from MCS: ref #1204994
2019-01-18 08:13:15 [INFO    ] Finished processing BAM request
2019-01-18 08:13:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204994   8 58501 29595030 A  ERROR'
2019-01-18 08:13:15 [DEBUG   ] Got command BAM from MCS: ref #1204995
2019-01-18 08:13:15 [INFO    ] Finished processing BAM request
2019-01-18 08:13:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204995   8 58501 29595034 A  ERROR'
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:13:15 [DEBUG   ] spawn_process: at 2019-01-18 08:13:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:13:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 08:13:35 [DEBUG   ] Got command BAM from MCS: ref #1204997
2019-01-18 08:13:35 [INFO    ] Finished processing BAM request
2019-01-18 08:13:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204997   8 58501 29615025 A  ERROR'
2019-01-18 08:13:35 [DEBUG   ] Got command BAM from MCS: ref #1204996
2019-01-18 08:13:35 [INFO    ] Finished processing BAM request
2019-01-18 08:13:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204996   8 58501 29615029 A  ERROR'
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:13:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:13:35 [DEBUG   ] spawn_process: at 2019-01-18 08:13:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:13:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 08:13:55 [DEBUG   ] Got command BAM from MCS: ref #1204999
2019-01-18 08:13:55 [INFO    ] Finished processing BAM request
2019-01-18 08:13:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204999   8 58501 29635029 A  ERROR'
2019-01-18 08:13:55 [DEBUG   ] Got command BAM from MCS: ref #1204998
2019-01-18 08:13:55 [INFO    ] Finished processing BAM request
2019-01-18 08:13:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1204998   8 58501 29635033 A  ERROR'
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:13:55 [DEBUG   ] spawn_process: at 2019-01-18 08:13:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 08:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:14:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:14:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:14:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:14:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:14:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:14:06 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-18 08:14:07 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-18 08:14:15 [DEBUG   ] Got command BAM from MCS: ref #1205000
2019-01-18 08:14:15 [INFO    ] Finished processing BAM request
2019-01-18 08:14:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205000   8 58501 29655033 A  ERROR'
2019-01-18 08:14:15 [DEBUG   ] Got command BAM from MCS: ref #1205001
2019-01-18 08:14:15 [INFO    ] Finished processing BAM request
2019-01-18 08:14:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205001   8 58501 29655037 A  ERROR'
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:14:15 [DEBUG   ] spawn_process: at 2019-01-18 08:14:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:14:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:14:35 [DEBUG   ] Got command BAM from MCS: ref #1205003
2019-01-18 08:14:35 [INFO    ] Finished processing BAM request
2019-01-18 08:14:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205003   8 58501 29675033 A  ERROR'
2019-01-18 08:14:35 [DEBUG   ] Got command BAM from MCS: ref #1205002
2019-01-18 08:14:35 [INFO    ] Finished processing BAM request
2019-01-18 08:14:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205002   8 58501 29675037 A  ERROR'
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:14:35 [DEBUG   ] spawn_process: at 2019-01-18 08:14:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:14:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:14:55 [DEBUG   ] Got command BAM from MCS: ref #1205005
2019-01-18 08:14:55 [INFO    ] Finished processing BAM request
2019-01-18 08:14:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205005   8 58501 29695029 A  ERROR'
2019-01-18 08:14:55 [DEBUG   ] Got command BAM from MCS: ref #1205004
2019-01-18 08:14:55 [INFO    ] Finished processing BAM request
2019-01-18 08:14:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205004   8 58501 29695033 A  ERROR'
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:14:55 [DEBUG   ] spawn_process: at 2019-01-18 08:14:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 08:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2019-01-18 08:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:15:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:15:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:15:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:15:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:15:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:15:06 [DEBUG   ] Finished updating board flags in 1.146 seconds
2019-01-18 08:15:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:15:16 [DEBUG   ] Got command BAM from MCS: ref #1205007
2019-01-18 08:15:16 [INFO    ] Finished processing BAM request
2019-01-18 08:15:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205007   8 58501 29716029 A  ERROR'
2019-01-18 08:15:16 [DEBUG   ] Got command BAM from MCS: ref #1205006
2019-01-18 08:15:16 [INFO    ] Finished processing BAM request
2019-01-18 08:15:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205006   8 58501 29716033 A  ERROR'
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:15:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:15:16 [DEBUG   ] spawn_process: at 2019-01-18 08:15:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:15:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:15:37 [DEBUG   ] Got command BAM from MCS: ref #1205013
2019-01-18 08:15:37 [INFO    ] Finished processing BAM request
2019-01-18 08:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205013   8 58501 29737025 A  ERROR'
2019-01-18 08:15:37 [DEBUG   ] Got command BAM from MCS: ref #1205012
2019-01-18 08:15:37 [INFO    ] Finished processing BAM request
2019-01-18 08:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205012   8 58501 29737029 A  ERROR'
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:15:37 [DEBUG   ] spawn_process: at 2019-01-18 08:15:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:15:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:15:58 [DEBUG   ] Got command BAM from MCS: ref #1205014
2019-01-18 08:15:58 [INFO    ] Finished processing BAM request
2019-01-18 08:15:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205014   8 58501 29758025 A  ERROR'
2019-01-18 08:15:58 [DEBUG   ] Got command BAM from MCS: ref #1205015
2019-01-18 08:15:58 [INFO    ] Finished processing BAM request
2019-01-18 08:15:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205015   8 58501 29758029 A  ERROR'
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:15:58 [DEBUG   ] spawn_process: at 2019-01-18 08:15:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:16:05 [DEBUG   ] Got command RPT from MCS: ref #1205016
2019-01-18 08:16:05 [DEBUG   ] summary = ERROR
2019-01-18 08:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205016  13 58501 29765901 A  ERRORERROR'
2019-01-18 08:16:05 [DEBUG   ] Got command RPT from MCS: ref #1205017
2019-01-18 08:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205017  77 58501 29765902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-18 08:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:16:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:16:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:16:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:16:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:16:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:16:06 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-18 08:16:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:16:19 [DEBUG   ] Got command BAM from MCS: ref #1205034
2019-01-18 08:16:19 [INFO    ] Finished processing BAM request
2019-01-18 08:16:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205034   8 58501 29779029 A  ERROR'
2019-01-18 08:16:19 [DEBUG   ] Got command BAM from MCS: ref #1205033
2019-01-18 08:16:19 [INFO    ] Finished processing BAM request
2019-01-18 08:16:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205033   8 58501 29779033 A  ERROR'
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:16:19 [DEBUG   ] spawn_process: at 2019-01-18 08:16:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:16:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:16:40 [DEBUG   ] Got command BAM from MCS: ref #1205036
2019-01-18 08:16:40 [INFO    ] Finished processing BAM request
2019-01-18 08:16:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205036   8 58501 29800025 A  ERROR'
2019-01-18 08:16:40 [DEBUG   ] Got command BAM from MCS: ref #1205035
2019-01-18 08:16:40 [INFO    ] Finished processing BAM request
2019-01-18 08:16:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205035   8 58501 29800029 A  ERROR'
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:16:40 [DEBUG   ] spawn_process: at 2019-01-18 08:16:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:16:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:17:01 [DEBUG   ] Got command BAM from MCS: ref #1205038
2019-01-18 08:17:01 [INFO    ] Finished processing BAM request
2019-01-18 08:17:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205038   8 58501 29821025 A  ERROR'
2019-01-18 08:17:01 [DEBUG   ] Got command BAM from MCS: ref #1205037
2019-01-18 08:17:01 [INFO    ] Finished processing BAM request
2019-01-18 08:17:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205037   8 58501 29821029 A  ERROR'
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:17:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:17:01 [DEBUG   ] spawn_process: at 2019-01-18 08:17:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:17:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:17:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-18 08:17:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:17:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:17:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:17:06 [WARNING ] (13, 1, 'bot')
2019-01-18 08:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:17:06 [DEBUG   ] Finished updating board flags in 0.983 seconds
2019-01-18 08:17:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:17:22 [DEBUG   ] Got command BAM from MCS: ref #1205041
2019-01-18 08:17:22 [INFO    ] Finished processing BAM request
2019-01-18 08:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205041   8 58501 29842025 A  ERROR'
2019-01-18 08:17:22 [DEBUG   ] Got command BAM from MCS: ref #1205042
2019-01-18 08:17:22 [INFO    ] Finished processing BAM request
2019-01-18 08:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205042   8 58501 29842029 A  ERROR'
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:17:22 [DEBUG   ] spawn_process: at 2019-01-18 08:17:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:17:26 [DEBUG   ] Got command RPT from MCS: ref #1205043
2019-01-18 08:17:26 [DEBUG   ] summary = ERROR
2019-01-18 08:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205043  13 58501 29846745 A  ERRORERROR'
2019-01-18 08:17:26 [DEBUG   ] Got command RPT from MCS: ref #1205044
2019-01-18 08:17:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205044  77 58501 29846949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:17:27 [DEBUG   ] Got command RPT from MCS: ref #1205045
2019-01-18 08:17:27 [DEBUG   ] summary = ERROR
2019-01-18 08:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205045  13 58501 29847149 A  ERRORERROR'
2019-01-18 08:17:27 [DEBUG   ] Got command RPT from MCS: ref #1205047
2019-01-18 08:17:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205047  77 58501 29847349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:17:27 [DEBUG   ] Got command RPT from MCS: ref #1205048
2019-01-18 08:17:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205048  12 58501 29847553 A  ERRORB¤ff'
2019-01-18 08:17:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:17:43 [DEBUG   ] Got command BAM from MCS: ref #1205053
2019-01-18 08:17:43 [INFO    ] Finished processing BAM request
2019-01-18 08:17:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205053   8 58501 29863029 A  ERROR'
2019-01-18 08:17:43 [DEBUG   ] Got command BAM from MCS: ref #1205054
2019-01-18 08:17:43 [INFO    ] Finished processing BAM request
2019-01-18 08:17:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205054   8 58501 29863033 A  ERROR'
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:17:43 [DEBUG   ] spawn_process: at 2019-01-18 08:17:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:17:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:18:04 [DEBUG   ] Got command BAM from MCS: ref #1205055
2019-01-18 08:18:04 [INFO    ] Finished processing BAM request
2019-01-18 08:18:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205055   8 58501 29884025 A  ERROR'
2019-01-18 08:18:04 [DEBUG   ] Got command BAM from MCS: ref #1205056
2019-01-18 08:18:04 [INFO    ] Finished processing BAM request
2019-01-18 08:18:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205056   8 58501 29884029 A  ERROR'
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:18:04 [DEBUG   ] spawn_process: at 2019-01-18 08:18:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 08:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-18 08:18:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:18:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:18:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:18:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:18:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:18:07 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-18 08:18:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:18:26 [DEBUG   ] Got command BAM from MCS: ref #1205057
2019-01-18 08:18:26 [INFO    ] Finished processing BAM request
2019-01-18 08:18:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205057   8 58501 29906029 A  ERROR'
2019-01-18 08:18:26 [DEBUG   ] Got command BAM from MCS: ref #1205058
2019-01-18 08:18:26 [INFO    ] Finished processing BAM request
2019-01-18 08:18:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205058   8 58501 29906033 A  ERROR'
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:18:26 [DEBUG   ] spawn_process: at 2019-01-18 08:18:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:18:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 08:18:48 [DEBUG   ] Got command BAM from MCS: ref #1205064
2019-01-18 08:18:48 [INFO    ] Finished processing BAM request
2019-01-18 08:18:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205064   8 58501 29928033 A  ERROR'
2019-01-18 08:18:48 [DEBUG   ] Got command BAM from MCS: ref #1205063
2019-01-18 08:18:48 [INFO    ] Finished processing BAM request
2019-01-18 08:18:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205063   8 58501 29928037 A  ERROR'
2019-01-18 08:18:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:18:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:18:48 [DEBUG   ] spawn_process: at 2019-01-18 08:18:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-18 08:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 08:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:19:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:19:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:19:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:19:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:19:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:19:07 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-18 08:19:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:19:10 [DEBUG   ] Got command BAM from MCS: ref #1205066
2019-01-18 08:19:10 [INFO    ] Finished processing BAM request
2019-01-18 08:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205066   8 58501 29950029 A  ERROR'
2019-01-18 08:19:10 [DEBUG   ] Got command BAM from MCS: ref #1205065
2019-01-18 08:19:10 [INFO    ] Finished processing BAM request
2019-01-18 08:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205065   8 58501 29950033 A  ERROR'
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:19:10 [DEBUG   ] spawn_process: at 2019-01-18 08:19:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:19:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:19:32 [DEBUG   ] Got command BAM from MCS: ref #1205067
2019-01-18 08:19:32 [INFO    ] Finished processing BAM request
2019-01-18 08:19:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205067   8 58501 29972025 A  ERROR'
2019-01-18 08:19:32 [DEBUG   ] Got command BAM from MCS: ref #1205068
2019-01-18 08:19:32 [INFO    ] Finished processing BAM request
2019-01-18 08:19:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205068   8 58501 29972029 A  ERROR'
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:19:32 [DEBUG   ] spawn_process: at 2019-01-18 08:19:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:19:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:19:54 [DEBUG   ] Got command BAM from MCS: ref #1205069
2019-01-18 08:19:54 [INFO    ] Finished processing BAM request
2019-01-18 08:19:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205069   8 58501 29994025 A  ERROR'
2019-01-18 08:19:54 [DEBUG   ] Got command BAM from MCS: ref #1205070
2019-01-18 08:19:54 [INFO    ] Finished processing BAM request
2019-01-18 08:19:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205070   8 58501 29994029 A  ERROR'
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:19:54 [DEBUG   ] spawn_process: at 2019-01-18 08:19:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:20:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:20:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:20:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:20:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:20:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:20:07 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-18 08:20:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:20:16 [DEBUG   ] Got command BAM from MCS: ref #1205071
2019-01-18 08:20:16 [INFO    ] Finished processing BAM request
2019-01-18 08:20:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205071   8 58501 30016025 A  ERROR'
2019-01-18 08:20:16 [DEBUG   ] Got command BAM from MCS: ref #1205072
2019-01-18 08:20:16 [INFO    ] Finished processing BAM request
2019-01-18 08:20:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205072   8 58501 30016029 A  ERROR'
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:20:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:20:16 [DEBUG   ] spawn_process: at 2019-01-18 08:20:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:20:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:20:38 [DEBUG   ] Got command BAM from MCS: ref #1205073
2019-01-18 08:20:38 [INFO    ] Finished processing BAM request
2019-01-18 08:20:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205073   8 58501 30038025 A  ERROR'
2019-01-18 08:20:38 [DEBUG   ] Got command BAM from MCS: ref #1205074
2019-01-18 08:20:38 [INFO    ] Finished processing BAM request
2019-01-18 08:20:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205074   8 58501 30038029 A  ERROR'
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:20:38 [DEBUG   ] spawn_process: at 2019-01-18 08:20:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:20:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:21:00 [DEBUG   ] Got command BAM from MCS: ref #1205075
2019-01-18 08:21:00 [INFO    ] Finished processing BAM request
2019-01-18 08:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205075   8 58501 30060025 A  ERROR'
2019-01-18 08:21:00 [DEBUG   ] Got command BAM from MCS: ref #1205076
2019-01-18 08:21:00 [INFO    ] Finished processing BAM request
2019-01-18 08:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205076   8 58501 30060029 A  ERROR'
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:21:00 [DEBUG   ] spawn_process: at 2019-01-18 08:21:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:21:05 [DEBUG   ] Got command RPT from MCS: ref #1205077
2019-01-18 08:21:05 [DEBUG   ] summary = ERROR
2019-01-18 08:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205077  13 58501 30065909 A  ERRORERROR'
2019-01-18 08:21:05 [DEBUG   ] Got command RPT from MCS: ref #1205078
2019-01-18 08:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205078  77 58501 30065910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 08:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:21:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:21:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-18 08:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-18 08:21:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:21:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:21:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:21:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:21:07 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-01-18 08:21:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:21:23 [DEBUG   ] Got command BAM from MCS: ref #1205094
2019-01-18 08:21:23 [INFO    ] Finished processing BAM request
2019-01-18 08:21:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205094   8 58501 30083029 A  ERROR'
2019-01-18 08:21:23 [DEBUG   ] Got command BAM from MCS: ref #1205095
2019-01-18 08:21:23 [INFO    ] Finished processing BAM request
2019-01-18 08:21:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205095   8 58501 30083033 A  ERROR'
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:21:23 [DEBUG   ] spawn_process: at 2019-01-18 08:21:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:21:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:21:46 [DEBUG   ] Got command BAM from MCS: ref #1205101
2019-01-18 08:21:46 [INFO    ] Finished processing BAM request
2019-01-18 08:21:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205101   8 58501 30106025 A  ERROR'
2019-01-18 08:21:46 [DEBUG   ] Got command BAM from MCS: ref #1205100
2019-01-18 08:21:46 [INFO    ] Finished processing BAM request
2019-01-18 08:21:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205100   8 58501 30106029 A  ERROR'
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:21:46 [DEBUG   ] spawn_process: at 2019-01-18 08:21:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:21:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:22:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:22:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 08:22:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:22:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:22:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:22:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:22:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:22:08 [DEBUG   ] Finished updating board flags in 2.154 seconds
2019-01-18 08:22:09 [DEBUG   ] Got command BAM from MCS: ref #1205102
2019-01-18 08:22:09 [INFO    ] Finished processing BAM request
2019-01-18 08:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205102   8 58501 30129025 A  ERROR'
2019-01-18 08:22:09 [DEBUG   ] Got command BAM from MCS: ref #1205103
2019-01-18 08:22:09 [INFO    ] Finished processing BAM request
2019-01-18 08:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205103   8 58501 30129029 A  ERROR'
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:22:09 [DEBUG   ] spawn_process: at 2019-01-18 08:22:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:22:26 [DEBUG   ] Got command RPT from MCS: ref #1205104
2019-01-18 08:22:26 [DEBUG   ] summary = ERROR
2019-01-18 08:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205104  13 58501 30146837 A  ERRORERROR'
2019-01-18 08:22:27 [DEBUG   ] Got command RPT from MCS: ref #1205105
2019-01-18 08:22:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205105  77 58501 30147029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:22:27 [DEBUG   ] Got command RPT from MCS: ref #1205106
2019-01-18 08:22:27 [DEBUG   ] summary = ERROR
2019-01-18 08:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205106  13 58501 30147233 A  ERRORERROR'
2019-01-18 08:22:27 [DEBUG   ] Got command RPT from MCS: ref #1205107
2019-01-18 08:22:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205107  77 58501 30147441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:22:27 [DEBUG   ] Got command RPT from MCS: ref #1205108
2019-01-18 08:22:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205108  12 58501 30147633 A  ERRORB£ff'
2019-01-18 08:22:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 08:22:32 [DEBUG   ] Got command BAM from MCS: ref #1205109
2019-01-18 08:22:32 [INFO    ] Finished processing BAM request
2019-01-18 08:22:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205109   8 58501 30152029 A  ERROR'
2019-01-18 08:22:32 [DEBUG   ] Got command BAM from MCS: ref #1205110
2019-01-18 08:22:32 [INFO    ] Finished processing BAM request
2019-01-18 08:22:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205110   8 58501 30152033 A  ERROR'
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:22:32 [DEBUG   ] spawn_process: at 2019-01-18 08:22:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:22:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:22:55 [DEBUG   ] Got command BAM from MCS: ref #1205111
2019-01-18 08:22:55 [INFO    ] Finished processing BAM request
2019-01-18 08:22:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:22:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205111   8 58501 30175033 A  ERROR'
2019-01-18 08:22:55 [DEBUG   ] Got command BAM from MCS: ref #1205112
2019-01-18 08:22:55 [INFO    ] Finished processing BAM request
2019-01-18 08:22:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:22:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205112   8 58501 30175037 A  ERROR'
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:22:55 [DEBUG   ] spawn_process: at 2019-01-18 08:22:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:23:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:23:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:23:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:23:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:23:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:23:07 [DEBUG   ] Finished updating board flags in 1.039 seconds
2019-01-18 08:23:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:23:18 [DEBUG   ] Got command BAM from MCS: ref #1205113
2019-01-18 08:23:18 [INFO    ] Finished processing BAM request
2019-01-18 08:23:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205113   8 58501 30198029 A  ERROR'
2019-01-18 08:23:18 [DEBUG   ] Got command BAM from MCS: ref #1205114
2019-01-18 08:23:18 [INFO    ] Finished processing BAM request
2019-01-18 08:23:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205114   8 58501 30198033 A  ERROR'
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:23:18 [DEBUG   ] spawn_process: at 2019-01-18 08:23:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:23:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 08:23:41 [DEBUG   ] Got command BAM from MCS: ref #1205116
2019-01-18 08:23:41 [INFO    ] Finished processing BAM request
2019-01-18 08:23:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205116   8 58501 30221025 A  ERROR'
2019-01-18 08:23:41 [DEBUG   ] Got command BAM from MCS: ref #1205115
2019-01-18 08:23:41 [INFO    ] Finished processing BAM request
2019-01-18 08:23:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205115   8 58501 30221029 A  ERROR'
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:23:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:23:41 [DEBUG   ] spawn_process: at 2019-01-18 08:23:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:23:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:24:05 [DEBUG   ] Got command BAM from MCS: ref #1205118
2019-01-18 08:24:05 [INFO    ] Finished processing BAM request
2019-01-18 08:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205118   8 58501 30245029 A  ERROR'
2019-01-18 08:24:05 [DEBUG   ] Got command BAM from MCS: ref #1205117
2019-01-18 08:24:05 [INFO    ] Finished processing BAM request
2019-01-18 08:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205117   8 58501 30245033 A  ERROR'
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:24:05 [DEBUG   ] spawn_process: at 2019-01-18 08:24:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:24:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:24:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:24:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:24:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:24:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:24:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:24:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:24:07 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-18 08:24:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 08:24:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:24:29 [DEBUG   ] Got command BAM from MCS: ref #1205119
2019-01-18 08:24:29 [INFO    ] Finished processing BAM request
2019-01-18 08:24:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205119   8 58501 30269029 A  ERROR'
2019-01-18 08:24:29 [DEBUG   ] Got command BAM from MCS: ref #1205120
2019-01-18 08:24:29 [INFO    ] Finished processing BAM request
2019-01-18 08:24:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205120   8 58501 30269033 A  ERROR'
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:24:29 [DEBUG   ] spawn_process: at 2019-01-18 08:24:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:24:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:24:53 [DEBUG   ] Got command BAM from MCS: ref #1205126
2019-01-18 08:24:53 [INFO    ] Finished processing BAM request
2019-01-18 08:24:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205126   8 58501 30293025 A  ERROR'
2019-01-18 08:24:53 [DEBUG   ] Got command BAM from MCS: ref #1205125
2019-01-18 08:24:53 [INFO    ] Finished processing BAM request
2019-01-18 08:24:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205125   8 58501 30293029 A  ERROR'
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:24:53 [DEBUG   ] spawn_process: at 2019-01-18 08:24:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 08:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:25:08 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2019-01-18 08:25:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:25:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:25:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:25:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:25:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:25:08 [DEBUG   ] Finished updating board flags in 1.864 seconds
2019-01-18 08:25:17 [DEBUG   ] Got command BAM from MCS: ref #1205127
2019-01-18 08:25:17 [INFO    ] Finished processing BAM request
2019-01-18 08:25:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205127   8 58501 30317033 A  ERROR'
2019-01-18 08:25:17 [DEBUG   ] Got command BAM from MCS: ref #1205128
2019-01-18 08:25:17 [INFO    ] Finished processing BAM request
2019-01-18 08:25:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205128   8 58501 30317037 A  ERROR'
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:25:17 [DEBUG   ] spawn_process: at 2019-01-18 08:25:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:25:28 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2019-01-18 08:25:41 [DEBUG   ] Got command BAM from MCS: ref #1205129
2019-01-18 08:25:41 [INFO    ] Finished processing BAM request
2019-01-18 08:25:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:25:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205129   8 58501 30341025 A  ERROR'
2019-01-18 08:25:41 [DEBUG   ] Got command BAM from MCS: ref #1205130
2019-01-18 08:25:41 [INFO    ] Finished processing BAM request
2019-01-18 08:25:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:25:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205130   8 58501 30341029 A  ERROR'
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:25:41 [DEBUG   ] spawn_process: at 2019-01-18 08:25:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:25:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:26:05 [DEBUG   ] Got command BAM from MCS: ref #1205131
2019-01-18 08:26:05 [INFO    ] Finished processing BAM request
2019-01-18 08:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205131   8 58501 30365025 A  ERROR'
2019-01-18 08:26:05 [DEBUG   ] Got command BAM from MCS: ref #1205132
2019-01-18 08:26:05 [INFO    ] Finished processing BAM request
2019-01-18 08:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205132   8 58501 30365029 A  ERROR'
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:26:05 [DEBUG   ] Got command RPT from MCS: ref #1205133
2019-01-18 08:26:05 [DEBUG   ] summary = ERROR
2019-01-18 08:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205133  13 58501 30365906 A  ERRORERROR'
2019-01-18 08:26:05 [DEBUG   ] Got command RPT from MCS: ref #1205134
2019-01-18 08:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205134  77 58501 30365906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:26:05 [DEBUG   ] spawn_process: at 2019-01-18 08:26:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:26:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:26:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:26:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:26:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:26:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:26:07 [DEBUG   ] Finished updating board flags in 1.237 seconds
2019-01-18 08:26:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:26:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:26:30 [DEBUG   ] Got command BAM from MCS: ref #1205150
2019-01-18 08:26:30 [INFO    ] Finished processing BAM request
2019-01-18 08:26:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:26:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205150   8 58501 30390029 A  ERROR'
2019-01-18 08:26:30 [DEBUG   ] Got command BAM from MCS: ref #1205151
2019-01-18 08:26:30 [INFO    ] Finished processing BAM request
2019-01-18 08:26:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:26:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205151   8 58501 30390033 A  ERROR'
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:26:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:26:30 [DEBUG   ] spawn_process: at 2019-01-18 08:26:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:26:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:26:55 [DEBUG   ] Got command BAM from MCS: ref #1205153
2019-01-18 08:26:55 [INFO    ] Finished processing BAM request
2019-01-18 08:26:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205153   8 58501 30415029 A  ERROR'
2019-01-18 08:26:55 [DEBUG   ] Got command BAM from MCS: ref #1205152
2019-01-18 08:26:55 [INFO    ] Finished processing BAM request
2019-01-18 08:26:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205152   8 58501 30415033 A  ERROR'
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:26:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:26:55 [DEBUG   ] spawn_process: at 2019-01-18 08:26:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 08:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:27:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:27:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:27:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:27:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:27:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:27:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:27:07 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-01-18 08:27:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:27:20 [DEBUG   ] Got command BAM from MCS: ref #1205157
2019-01-18 08:27:20 [INFO    ] Finished processing BAM request
2019-01-18 08:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205157   8 58501 30440033 A  ERROR'
2019-01-18 08:27:20 [DEBUG   ] Got command BAM from MCS: ref #1205156
2019-01-18 08:27:20 [INFO    ] Finished processing BAM request
2019-01-18 08:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205156   8 58501 30440037 A  ERROR'
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:27:20 [DEBUG   ] spawn_process: at 2019-01-18 08:27:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:27:26 [DEBUG   ] Got command RPT from MCS: ref #1205158
2019-01-18 08:27:26 [DEBUG   ] summary = ERROR
2019-01-18 08:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205158  13 58501 30446917 A  ERRORERROR'
2019-01-18 08:27:27 [DEBUG   ] Got command RPT from MCS: ref #1205159
2019-01-18 08:27:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205159  77 58501 30447121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:27:27 [DEBUG   ] Got command RPT from MCS: ref #1205160
2019-01-18 08:27:27 [DEBUG   ] summary = ERROR
2019-01-18 08:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205160  13 58501 30447313 A  ERRORERROR'
2019-01-18 08:27:27 [DEBUG   ] Got command RPT from MCS: ref #1205162
2019-01-18 08:27:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205162  77 58501 30447517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:27:27 [DEBUG   ] Got command RPT from MCS: ref #1205164
2019-01-18 08:27:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205164  12 58501 30447721 A  ERRORB£ff'
2019-01-18 08:27:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:27:45 [DEBUG   ] Got command BAM from MCS: ref #1205173
2019-01-18 08:27:45 [INFO    ] Finished processing BAM request
2019-01-18 08:27:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:27:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205173   8 58501 30465033 A  ERROR'
2019-01-18 08:27:45 [DEBUG   ] Got command BAM from MCS: ref #1205172
2019-01-18 08:27:45 [INFO    ] Finished processing BAM request
2019-01-18 08:27:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:27:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205172   8 58501 30465037 A  ERROR'
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:27:45 [DEBUG   ] spawn_process: at 2019-01-18 08:27:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:27:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-18 08:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:28:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:28:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:28:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:28:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:28:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:28:07 [DEBUG   ] Finished updating board flags in 1.138 seconds
2019-01-18 08:28:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:28:10 [DEBUG   ] Got command BAM from MCS: ref #1205175
2019-01-18 08:28:10 [INFO    ] Finished processing BAM request
2019-01-18 08:28:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205175   8 58501 30490029 A  ERROR'
2019-01-18 08:28:10 [DEBUG   ] Got command BAM from MCS: ref #1205174
2019-01-18 08:28:10 [INFO    ] Finished processing BAM request
2019-01-18 08:28:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205174   8 58501 30490033 A  ERROR'
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:28:10 [DEBUG   ] spawn_process: at 2019-01-18 08:28:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:28:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:28:36 [DEBUG   ] Got command BAM from MCS: ref #1205177
2019-01-18 08:28:36 [INFO    ] Finished processing BAM request
2019-01-18 08:28:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205177   8 58501 30516025 A  ERROR'
2019-01-18 08:28:36 [DEBUG   ] Got command BAM from MCS: ref #1205176
2019-01-18 08:28:36 [INFO    ] Finished processing BAM request
2019-01-18 08:28:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205176   8 58501 30516029 A  ERROR'
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:28:36 [DEBUG   ] spawn_process: at 2019-01-18 08:28:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:28:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:29:02 [DEBUG   ] Got command BAM from MCS: ref #1205179
2019-01-18 08:29:02 [INFO    ] Finished processing BAM request
2019-01-18 08:29:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205179   8 58501 30542025 A  ERROR'
2019-01-18 08:29:02 [DEBUG   ] Got command BAM from MCS: ref #1205178
2019-01-18 08:29:02 [INFO    ] Finished processing BAM request
2019-01-18 08:29:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205178   8 58501 30542029 A  ERROR'
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:29:02 [DEBUG   ] spawn_process: at 2019-01-18 08:29:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-18 08:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:29:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-18 08:29:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:29:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-18 08:29:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:29:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:29:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:29:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:29:07 [WARNING ] (13, 1, 'bot')
2019-01-18 08:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:29:07 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-18 08:29:08 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 08:29:28 [DEBUG   ] Got command BAM from MCS: ref #1205180
2019-01-18 08:29:28 [INFO    ] Finished processing BAM request
2019-01-18 08:29:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:29:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205180   8 58501 30568033 A  ERROR'
2019-01-18 08:29:28 [DEBUG   ] Got command BAM from MCS: ref #1205181
2019-01-18 08:29:28 [INFO    ] Finished processing BAM request
2019-01-18 08:29:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:29:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205181   8 58501 30568037 A  ERROR'
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:29:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:29:28 [DEBUG   ] spawn_process: at 2019-01-18 08:29:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:29:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 08:29:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:29:54 [DEBUG   ] Got command BAM from MCS: ref #1205182
2019-01-18 08:29:54 [INFO    ] Finished processing BAM request
2019-01-18 08:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205182   8 58501 30594025 A  ERROR'
2019-01-18 08:29:54 [DEBUG   ] Got command BAM from MCS: ref #1205183
2019-01-18 08:29:54 [INFO    ] Finished processing BAM request
2019-01-18 08:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205183   8 58501 30594029 A  ERROR'
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:29:54 [DEBUG   ] spawn_process: at 2019-01-18 08:29:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 08:30:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:30:08 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:30:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:30:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:30:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:30:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:30:08 [DEBUG   ] Finished updating board flags in 1.375 seconds
2019-01-18 08:30:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:30:20 [DEBUG   ] Got command BAM from MCS: ref #1205185
2019-01-18 08:30:20 [INFO    ] Finished processing BAM request
2019-01-18 08:30:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205185   8 58501 30620025 A  ERROR'
2019-01-18 08:30:20 [DEBUG   ] Got command BAM from MCS: ref #1205184
2019-01-18 08:30:20 [INFO    ] Finished processing BAM request
2019-01-18 08:30:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205184   8 58501 30620029 A  ERROR'
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:30:20 [DEBUG   ] spawn_process: at 2019-01-18 08:30:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:30:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 08:30:47 [DEBUG   ] Got command BAM from MCS: ref #1205191
2019-01-18 08:30:47 [INFO    ] Finished processing BAM request
2019-01-18 08:30:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:30:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205191   8 58501 30647025 A  ERROR'
2019-01-18 08:30:47 [DEBUG   ] Got command BAM from MCS: ref #1205190
2019-01-18 08:30:47 [INFO    ] Finished processing BAM request
2019-01-18 08:30:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:30:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205190   8 58501 30647029 A  ERROR'
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:30:47 [DEBUG   ] spawn_process: at 2019-01-18 08:30:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:30:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:31:05 [DEBUG   ] Got command RPT from MCS: ref #1205192
2019-01-18 08:31:05 [DEBUG   ] summary = ERROR
2019-01-18 08:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205192  13 58501 30665909 A  ERRORERROR'
2019-01-18 08:31:05 [DEBUG   ] Got command RPT from MCS: ref #1205193
2019-01-18 08:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205193  77 58501 30665910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-18 08:31:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:31:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:31:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:31:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:31:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:31:08 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-18 08:31:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:31:14 [DEBUG   ] Got command BAM from MCS: ref #1205210
2019-01-18 08:31:14 [INFO    ] Finished processing BAM request
2019-01-18 08:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205210   8 58501 30674025 A  ERROR'
2019-01-18 08:31:14 [DEBUG   ] Got command BAM from MCS: ref #1205209
2019-01-18 08:31:14 [INFO    ] Finished processing BAM request
2019-01-18 08:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205209   8 58501 30674029 A  ERROR'
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:31:14 [DEBUG   ] spawn_process: at 2019-01-18 08:31:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:31:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:31:41 [DEBUG   ] Got command BAM from MCS: ref #1205211
2019-01-18 08:31:41 [INFO    ] Finished processing BAM request
2019-01-18 08:31:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205211   8 58501 30701025 A  ERROR'
2019-01-18 08:31:41 [DEBUG   ] Got command BAM from MCS: ref #1205212
2019-01-18 08:31:41 [INFO    ] Finished processing BAM request
2019-01-18 08:31:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205212   8 58501 30701029 A  ERROR'
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:31:41 [DEBUG   ] spawn_process: at 2019-01-18 08:31:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:31:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-18 08:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 08:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:32:08 [DEBUG   ] Got command BAM from MCS: ref #1205214
2019-01-18 08:32:08 [INFO    ] Finished processing BAM request
2019-01-18 08:32:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:32:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205214   8 58501 30728033 A  ERROR'
2019-01-18 08:32:08 [DEBUG   ] Got command BAM from MCS: ref #1205213
2019-01-18 08:32:08 [INFO    ] Finished processing BAM request
2019-01-18 08:32:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:32:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205213   8 58501 30728037 A  ERROR'
2019-01-18 08:32:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:32:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:32:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:32:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:32:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:32:08 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:32:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:32:08 [DEBUG   ] spawn_process: at 2019-01-18 08:32:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:32:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 08:32:27 [DEBUG   ] Got command RPT from MCS: ref #1205215
2019-01-18 08:32:27 [DEBUG   ] summary = ERROR
2019-01-18 08:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205215  13 58501 30747009 A  ERRORERROR'
2019-01-18 08:32:27 [DEBUG   ] Got command RPT from MCS: ref #1205216
2019-01-18 08:32:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205216  77 58501 30747201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:32:27 [DEBUG   ] Got command RPT from MCS: ref #1205217
2019-01-18 08:32:27 [DEBUG   ] summary = ERROR
2019-01-18 08:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205217  13 58501 30747405 A  ERRORERROR'
2019-01-18 08:32:27 [DEBUG   ] Got command RPT from MCS: ref #1205218
2019-01-18 08:32:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205218  77 58501 30747609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:32:27 [DEBUG   ] Got command RPT from MCS: ref #1205219
2019-01-18 08:32:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205219  12 58501 30747813 A  ERRORB¤ff'
2019-01-18 08:32:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:32:35 [DEBUG   ] Got command BAM from MCS: ref #1205221
2019-01-18 08:32:35 [INFO    ] Finished processing BAM request
2019-01-18 08:32:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205221   8 58501 30755025 A  ERROR'
2019-01-18 08:32:35 [DEBUG   ] Got command BAM from MCS: ref #1205220
2019-01-18 08:32:35 [INFO    ] Finished processing BAM request
2019-01-18 08:32:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205220   8 58501 30755029 A  ERROR'
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-18 08:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-18 08:32:35 [DEBUG   ] spawn_process: at 2019-01-18 08:32:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-18 08:32:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:33:03 [DEBUG   ] Got command BAM from MCS: ref #1205223
2019-01-18 08:33:03 [INFO    ] Finished processing BAM request
2019-01-18 08:33:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205223   8 58501 30783033 A  ERROR'
2019-01-18 08:33:03 [DEBUG   ] Got command BAM from MCS: ref #1205222
2019-01-18 08:33:03 [INFO    ] Finished processing BAM request
2019-01-18 08:33:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205222   8 58501 30783037 A  ERROR'
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:33:03 [DEBUG   ] spawn_process: at 2019-01-18 08:33:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-18 08:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 08:33:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 08:33:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-18 08:33:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:33:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:33:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:33:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:33:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:33:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:33:09 [DEBUG   ] Finished updating board flags in 2.338 seconds
2019-01-18 08:33:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 08:33:31 [DEBUG   ] Got command BAM from MCS: ref #1205225
2019-01-18 08:33:31 [INFO    ] Finished processing BAM request
2019-01-18 08:33:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205225   8 58501 30811033 A  ERROR'
2019-01-18 08:33:31 [DEBUG   ] Got command BAM from MCS: ref #1205224
2019-01-18 08:33:31 [INFO    ] Finished processing BAM request
2019-01-18 08:33:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205224   8 58501 30811037 A  ERROR'
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:33:31 [DEBUG   ] spawn_process: at 2019-01-18 08:33:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:33:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:33:59 [DEBUG   ] Got command BAM from MCS: ref #1205231
2019-01-18 08:33:59 [INFO    ] Finished processing BAM request
2019-01-18 08:33:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205231   8 58501 30839025 A  ERROR'
2019-01-18 08:33:59 [DEBUG   ] Got command BAM from MCS: ref #1205230
2019-01-18 08:33:59 [INFO    ] Finished processing BAM request
2019-01-18 08:33:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205230   8 58501 30839029 A  ERROR'
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:33:59 [DEBUG   ] spawn_process: at 2019-01-18 08:33:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:34:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:34:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-18 08:34:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:34:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:34:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:34:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:34:08 [DEBUG   ] Finished updating board flags in 1.039 seconds
2019-01-18 08:34:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:34:27 [DEBUG   ] Got command BAM from MCS: ref #1205233
2019-01-18 08:34:27 [INFO    ] Finished processing BAM request
2019-01-18 08:34:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205233   8 58501 30867029 A  ERROR'
2019-01-18 08:34:27 [DEBUG   ] Got command BAM from MCS: ref #1205232
2019-01-18 08:34:27 [INFO    ] Finished processing BAM request
2019-01-18 08:34:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205232   8 58501 30867033 A  ERROR'
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-18 08:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-18 08:34:27 [DEBUG   ] spawn_process: at 2019-01-18 08:34:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-18 08:34:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:34:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 08:34:56 [DEBUG   ] Got command BAM from MCS: ref #1205235
2019-01-18 08:34:56 [INFO    ] Finished processing BAM request
2019-01-18 08:34:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205235   8 58501 30896033 A  ERROR'
2019-01-18 08:34:56 [DEBUG   ] Got command BAM from MCS: ref #1205234
2019-01-18 08:34:56 [INFO    ] Finished processing BAM request
2019-01-18 08:34:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205234   8 58501 30896037 A  ERROR'
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-18 08:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-18 08:34:56 [DEBUG   ] spawn_process: at 2019-01-18 08:34:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-18 08:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-18 08:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:35:09 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2019-01-18 08:35:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:35:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:35:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:35:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:35:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:35:09 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-01-18 08:35:25 [DEBUG   ] Got command BAM from MCS: ref #1205236
2019-01-18 08:35:25 [INFO    ] Finished processing BAM request
2019-01-18 08:35:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205236   8 58501 30925026 A  ERROR'
2019-01-18 08:35:25 [DEBUG   ] Got command BAM from MCS: ref #1205237
2019-01-18 08:35:25 [INFO    ] Finished processing BAM request
2019-01-18 08:35:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205237   8 58501 30925030 A  ERROR'
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:35:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:35:25 [DEBUG   ] spawn_process: at 2019-01-18 08:35:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:35:29 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2019-01-18 08:35:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:35:54 [DEBUG   ] Got command BAM from MCS: ref #1205239
2019-01-18 08:35:54 [INFO    ] Finished processing BAM request
2019-01-18 08:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205239   8 58501 30954026 A  ERROR'
2019-01-18 08:35:54 [DEBUG   ] Got command BAM from MCS: ref #1205238
2019-01-18 08:35:54 [INFO    ] Finished processing BAM request
2019-01-18 08:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205238   8 58501 30954030 A  ERROR'
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:35:54 [DEBUG   ] spawn_process: at 2019-01-18 08:35:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:36:05 [DEBUG   ] Got command RPT from MCS: ref #1205240
2019-01-18 08:36:05 [DEBUG   ] summary = ERROR
2019-01-18 08:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205240  13 58501 30965909 A  ERRORERROR'
2019-01-18 08:36:05 [DEBUG   ] Got command RPT from MCS: ref #1205241
2019-01-18 08:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205241  77 58501 30965910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:36:09 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2019-01-18 08:36:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:36:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:36:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:36:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:36:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:36:09 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-18 08:36:23 [DEBUG   ] Got command BAM from MCS: ref #1205257
2019-01-18 08:36:23 [INFO    ] Finished processing BAM request
2019-01-18 08:36:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205257   8 58501 30983029 A  ERROR'
2019-01-18 08:36:23 [DEBUG   ] Got command BAM from MCS: ref #1205258
2019-01-18 08:36:23 [INFO    ] Finished processing BAM request
2019-01-18 08:36:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205258   8 58501 30983033 A  ERROR'
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:36:23 [DEBUG   ] spawn_process: at 2019-01-18 08:36:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:36:29 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2019-01-18 08:36:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:36:53 [DEBUG   ] Got command BAM from MCS: ref #1205263
2019-01-18 08:36:53 [INFO    ] Finished processing BAM request
2019-01-18 08:36:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205263   8 58501 31013029 A  ERROR'
2019-01-18 08:36:53 [DEBUG   ] Got command BAM from MCS: ref #1205264
2019-01-18 08:36:53 [INFO    ] Finished processing BAM request
2019-01-18 08:36:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205264   8 58501 31013033 A  ERROR'
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:36:53 [DEBUG   ] spawn_process: at 2019-01-18 08:36:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:37:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:37:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 08:37:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:37:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:37:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:37:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:37:08 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-18 08:37:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 08:37:23 [DEBUG   ] Got command BAM from MCS: ref #1205267
2019-01-18 08:37:23 [INFO    ] Finished processing BAM request
2019-01-18 08:37:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205267   8 58501 31043029 A  ERROR'
2019-01-18 08:37:23 [DEBUG   ] Got command BAM from MCS: ref #1205268
2019-01-18 08:37:23 [INFO    ] Finished processing BAM request
2019-01-18 08:37:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205268   8 58501 31043033 A  ERROR'
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:37:23 [DEBUG   ] spawn_process: at 2019-01-18 08:37:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:37:27 [DEBUG   ] Got command RPT from MCS: ref #1205269
2019-01-18 08:37:27 [DEBUG   ] summary = ERROR
2019-01-18 08:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205269  13 58501 31047093 A  ERRORERROR'
2019-01-18 08:37:27 [DEBUG   ] Got command RPT from MCS: ref #1205270
2019-01-18 08:37:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205270  77 58501 31047297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:37:27 [DEBUG   ] Got command RPT from MCS: ref #1205271
2019-01-18 08:37:27 [DEBUG   ] summary = ERROR
2019-01-18 08:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205271  13 58501 31047489 A  ERRORERROR'
2019-01-18 08:37:27 [DEBUG   ] Got command RPT from MCS: ref #1205273
2019-01-18 08:37:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205273  77 58501 31047693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:37:27 [DEBUG   ] Got command RPT from MCS: ref #1205275
2019-01-18 08:37:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205275  12 58501 31047897 A  ERRORB£ff'
2019-01-18 08:37:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:37:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:37:53 [DEBUG   ] Got command BAM from MCS: ref #1205280
2019-01-18 08:37:53 [INFO    ] Finished processing BAM request
2019-01-18 08:37:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:37:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205280   8 58501 31073025 A  ERROR'
2019-01-18 08:37:53 [DEBUG   ] Got command BAM from MCS: ref #1205279
2019-01-18 08:37:53 [INFO    ] Finished processing BAM request
2019-01-18 08:37:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-18 08:37:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1205279   8 58501 31073029 A  ERROR'
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-18 08:37:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-18 08:37:53 [DEBUG   ] spawn_process: at 2019-01-18 08:37:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-18 08:38:07 [DEBUG   ] Got command STP from MCS: ref #1205282
2019-01-18 08:38:07 [INFO    ] Finished processing BAM request
2019-01-18 08:38:07 [INFO    ] Shutdown the adder chain on beam #3
2019-01-18 08:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1205282   8 58501 31087033 A  ERROR'
2019-01-18 08:38:07 [DEBUG   ] Got command STP from MCS: ref #1205281
2019-01-18 08:38:07 [INFO    ] Finished processing BAM request
2019-01-18 08:38:07 [INFO    ] Shutdown the adder chain on beam #2
2019-01-18 08:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1205281   8 58501 31087037 A  ERROR'
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-18 08:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-18 08:38:07 [DEBUG   ] spawn_process: at 2019-01-18 08:38:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-18 08:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 08:38:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-18 08:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-18 08:38:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:38:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:38:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:38:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:38:08 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-18 08:38:09 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-18 08:38:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:38:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:39:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:39:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:39:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:39:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:39:08 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-01-18 08:39:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:39:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:39:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:40:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:40:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:40:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:40:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:40:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:40:08 [DEBUG   ] Finished updating board flags in 1.134 seconds
2019-01-18 08:40:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:40:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:40:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:41:05 [DEBUG   ] Got command RPT from MCS: ref #1205287
2019-01-18 08:41:05 [DEBUG   ] summary = ERROR
2019-01-18 08:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205287  13 58501 31265905 A  ERRORERROR'
2019-01-18 08:41:05 [DEBUG   ] Got command RPT from MCS: ref #1205288
2019-01-18 08:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205288  77 58501 31265906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:41:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:41:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:41:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:41:08 [WARNING ] (13, 1, 'bot')
2019-01-18 08:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:41:08 [DEBUG   ] Finished updating board flags in 1.083 seconds
2019-01-18 08:41:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:41:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:41:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:42:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:42:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:42:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:42:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:42:09 [DEBUG   ] Finished updating board flags in 1.528 seconds
2019-01-18 08:42:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:42:27 [DEBUG   ] Got command RPT from MCS: ref #1205304
2019-01-18 08:42:27 [DEBUG   ] summary = ERROR
2019-01-18 08:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205304  13 58501 31347169 A  ERRORERROR'
2019-01-18 08:42:27 [DEBUG   ] Got command RPT from MCS: ref #1205305
2019-01-18 08:42:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205305  77 58501 31347373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:42:27 [DEBUG   ] Got command RPT from MCS: ref #1205306
2019-01-18 08:42:27 [DEBUG   ] summary = ERROR
2019-01-18 08:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205306  13 58501 31347577 A  ERRORERROR'
2019-01-18 08:42:27 [DEBUG   ] Got command RPT from MCS: ref #1205307
2019-01-18 08:42:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205307  77 58501 31347781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:42:27 [DEBUG   ] Got command RPT from MCS: ref #1205308
2019-01-18 08:42:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205308  12 58501 31347973 A  ERRORBš™š'
2019-01-18 08:42:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:42:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:43:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:43:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:43:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:43:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:43:09 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-18 08:43:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 08:43:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:43:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:44:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:44:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:44:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:44:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:44:09 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-01-18 08:44:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:44:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:44:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:45:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:45:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:45:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:45:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:45:09 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-01-18 08:45:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 08:45:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:45:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:46:05 [DEBUG   ] Got command RPT from MCS: ref #1205317
2019-01-18 08:46:05 [DEBUG   ] summary = ERROR
2019-01-18 08:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205317  13 58501 31565917 A  ERRORERROR'
2019-01-18 08:46:05 [DEBUG   ] Got command RPT from MCS: ref #1205318
2019-01-18 08:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205318  77 58501 31565918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:46:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:46:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 08:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 08:46:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:46:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:46:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:46:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:46:09 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-01-18 08:46:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:46:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:46:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:47:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:47:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 08:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:47:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:47:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:47:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:47:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:47:10 [DEBUG   ] Finished updating board flags in 2.503 seconds
2019-01-18 08:47:27 [DEBUG   ] Got command RPT from MCS: ref #1205336
2019-01-18 08:47:27 [DEBUG   ] summary = ERROR
2019-01-18 08:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205336  13 58501 31647261 A  ERRORERROR'
2019-01-18 08:47:27 [DEBUG   ] Got command RPT from MCS: ref #1205337
2019-01-18 08:47:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205337  77 58501 31647453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:47:27 [DEBUG   ] Got command RPT from MCS: ref #1205338
2019-01-18 08:47:27 [DEBUG   ] summary = ERROR
2019-01-18 08:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205338  13 58501 31647657 A  ERRORERROR'
2019-01-18 08:47:27 [DEBUG   ] Got command RPT from MCS: ref #1205340
2019-01-18 08:47:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205340  77 58501 31647861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:47:28 [DEBUG   ] Got command RPT from MCS: ref #1205342
2019-01-18 08:47:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205342  12 58501 31648065 A  ERRORB™™š'
2019-01-18 08:47:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:47:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:48:10 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2019-01-18 08:48:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:48:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:48:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:48:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:48:10 [DEBUG   ] Finished updating board flags in 1.943 seconds
2019-01-18 08:48:30 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2019-01-18 08:48:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:49:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:49:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:49:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:49:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:49:09 [DEBUG   ] Finished updating board flags in 1.236 seconds
2019-01-18 08:49:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:49:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:49:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:50:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:50:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:50:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:50:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:50:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:50:09 [DEBUG   ] Finished updating board flags in 1.197 seconds
2019-01-18 08:50:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 08:50:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:50:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:51:05 [DEBUG   ] Got command RPT from MCS: ref #1205350
2019-01-18 08:51:05 [DEBUG   ] summary = ERROR
2019-01-18 08:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205350  13 58501 31865909 A  ERRORERROR'
2019-01-18 08:51:05 [DEBUG   ] Got command RPT from MCS: ref #1205351
2019-01-18 08:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205351  77 58501 31865910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:51:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:51:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:51:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:51:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:51:09 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-18 08:51:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 08:51:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:51:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:52:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:52:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:52:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:52:09 [WARNING ] (13, 1, 'bot')
2019-01-18 08:52:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:52:09 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-01-18 08:52:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 08:52:27 [DEBUG   ] Got command RPT from MCS: ref #1205371
2019-01-18 08:52:27 [DEBUG   ] summary = ERROR
2019-01-18 08:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205371  13 58501 31947337 A  ERRORERROR'
2019-01-18 08:52:27 [DEBUG   ] Got command RPT from MCS: ref #1205372
2019-01-18 08:52:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205372  77 58501 31947541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:52:27 [DEBUG   ] Got command RPT from MCS: ref #1205373
2019-01-18 08:52:27 [DEBUG   ] summary = ERROR
2019-01-18 08:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205373  13 58501 31947733 A  ERRORERROR'
2019-01-18 08:52:27 [DEBUG   ] Got command RPT from MCS: ref #1205374
2019-01-18 08:52:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205374  77 58501 31947937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:52:28 [DEBUG   ] Got command RPT from MCS: ref #1205375
2019-01-18 08:52:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205375  12 58501 31948141 A  ERRORB™™š'
2019-01-18 08:52:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:52:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:53:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 08:53:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:53:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:53:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:53:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:53:10 [DEBUG   ] Finished updating board flags in 1.501 seconds
2019-01-18 08:53:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:53:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 08:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:54:10 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2019-01-18 08:54:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:54:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:54:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:54:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:54:10 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-01-18 08:54:30 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2019-01-18 08:54:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 08:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:55:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 08:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:55:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:55:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:55:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:55:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:55:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:55:11 [DEBUG   ] Finished updating board flags in 2.475 seconds
2019-01-18 08:55:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 08:55:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:56:05 [DEBUG   ] Got command RPT from MCS: ref #1205380
2019-01-18 08:56:05 [DEBUG   ] summary = ERROR
2019-01-18 08:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205380  13 58501 32165913 A  ERRORERROR'
2019-01-18 08:56:05 [DEBUG   ] Got command RPT from MCS: ref #1205381
2019-01-18 08:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205381  77 58501 32165914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:56:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 08:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 08:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 08:56:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:56:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:56:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:56:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:56:10 [DEBUG   ] Finished updating board flags in 1.296 seconds
2019-01-18 08:56:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 08:56:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 08:56:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:57:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:57:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:57:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:57:10 [WARNING ] (13, 1, 'bot')
2019-01-18 08:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:57:10 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-01-18 08:57:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:57:27 [DEBUG   ] Got command RPT from MCS: ref #1205399
2019-01-18 08:57:27 [DEBUG   ] summary = ERROR
2019-01-18 08:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205399  13 58501 32247421 A  ERRORERROR'
2019-01-18 08:57:27 [DEBUG   ] Got command RPT from MCS: ref #1205400
2019-01-18 08:57:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205400  77 58501 32247613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:57:27 [DEBUG   ] Got command RPT from MCS: ref #1205401
2019-01-18 08:57:27 [DEBUG   ] summary = ERROR
2019-01-18 08:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205401  13 58501 32247817 A  ERRORERROR'
2019-01-18 08:57:28 [DEBUG   ] Got command RPT from MCS: ref #1205403
2019-01-18 08:57:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 08:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205403  77 58501 32248021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 08:57:28 [DEBUG   ] Got command RPT from MCS: ref #1205405
2019-01-18 08:57:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 08:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205405  12 58501 32248225 A  ERRORB™™š'
2019-01-18 08:57:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 08:57:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 08:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:58:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 08:58:11 [DEBUG   ] Finished updating ant stats in 0.834 seconds
2019-01-18 08:58:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:58:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:58:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:58:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:58:11 [DEBUG   ] Finished updating board flags in 2.073 seconds
2019-01-18 08:58:31 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2019-01-18 08:58:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 08:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 08:59:11 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2019-01-18 08:59:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:59:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:59:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:59:11 [WARNING ] (13, 1, 'bot')
2019-01-18 08:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 08:59:11 [DEBUG   ] Finished updating board flags in 1.964 seconds
2019-01-18 08:59:31 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2019-01-18 08:59:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 09:00:00 [DEBUG   ] Got command TBN from MCS: ref #1205413
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-18 09:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1205413   8 58501 32400885 A  ERROR'
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547802002']
2019-01-18 09:00:00 [DEBUG   ] spawn_process: at 2019-01-18 09:00:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547802002']
2019-01-18 09:00:00 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-18 09:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:00:11 [DEBUG   ] Finished updating ant stats in 0.510 seconds
2019-01-18 09:00:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:00:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:00:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:00:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:00:11 [DEBUG   ] Finished updating board flags in 2.051 seconds
2019-01-18 09:00:32 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2019-01-18 09:00:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:01:05 [DEBUG   ] Got command RPT from MCS: ref #1205418
2019-01-18 09:01:05 [DEBUG   ] summary = ERROR
2019-01-18 09:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205418  13 58501 32465921 A  ERRORERROR'
2019-01-18 09:01:05 [DEBUG   ] Got command RPT from MCS: ref #1205419
2019-01-18 09:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205419  77 58501 32465922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:01:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:01:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:01:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:01:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:01:11 [DEBUG   ] Finished updating board flags in 1.975 seconds
2019-01-18 09:01:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:01:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:01:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:02:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:02:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:02:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:02:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:02:11 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-01-18 09:02:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:02:27 [DEBUG   ] Got command RPT from MCS: ref #1205435
2019-01-18 09:02:27 [DEBUG   ] summary = ERROR
2019-01-18 09:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205435  13 58501 32547520 A  ERRORERROR'
2019-01-18 09:02:27 [DEBUG   ] Got command RPT from MCS: ref #1205436
2019-01-18 09:02:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205436  77 58501 32547697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:02:27 [DEBUG   ] Got command RPT from MCS: ref #1205437
2019-01-18 09:02:27 [DEBUG   ] summary = ERROR
2019-01-18 09:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205437  13 58501 32547901 A  ERRORERROR'
2019-01-18 09:02:28 [DEBUG   ] Got command RPT from MCS: ref #1205438
2019-01-18 09:02:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205438  77 58501 32548105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:02:28 [DEBUG   ] Got command RPT from MCS: ref #1205439
2019-01-18 09:02:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205439  12 58501 32548309 A  ERRORB˜™š'
2019-01-18 09:02:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:02:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:03:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:03:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:03:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:03:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:03:11 [DEBUG   ] Finished updating board flags in 1.833 seconds
2019-01-18 09:03:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:03:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:03:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:04:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:04:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:04:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:04:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:04:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:04:11 [DEBUG   ] Finished updating board flags in 1.740 seconds
2019-01-18 09:04:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:04:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:04:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:05:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 09:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:05:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:05:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:05:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:05:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:05:11 [DEBUG   ] Finished updating board flags in 1.666 seconds
2019-01-18 09:05:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:05:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:05:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:06:05 [DEBUG   ] Got command RPT from MCS: ref #1205452
2019-01-18 09:06:05 [DEBUG   ] summary = ERROR
2019-01-18 09:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205452  13 58501 32765917 A  ERRORERROR'
2019-01-18 09:06:05 [DEBUG   ] Got command RPT from MCS: ref #1205453
2019-01-18 09:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205453  77 58501 32765918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:06:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 09:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:06:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 09:06:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:06:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:06:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:06:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:06:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:06:11 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-18 09:06:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:06:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:06:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:07:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:07:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:07:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:07:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:07:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:07:11 [DEBUG   ] Finished updating board flags in 1.558 seconds
2019-01-18 09:07:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:07:27 [DEBUG   ] Got command RPT from MCS: ref #1205478
2019-01-18 09:07:27 [DEBUG   ] summary = ERROR
2019-01-18 09:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205478  13 58501 32847581 A  ERRORERROR'
2019-01-18 09:07:27 [DEBUG   ] Got command RPT from MCS: ref #1205479
2019-01-18 09:07:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205479  77 58501 32847785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:07:27 [DEBUG   ] Got command RPT from MCS: ref #1205480
2019-01-18 09:07:27 [DEBUG   ] summary = ERROR
2019-01-18 09:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205480  13 58501 32847989 A  ERRORERROR'
2019-01-18 09:07:28 [DEBUG   ] Got command RPT from MCS: ref #1205482
2019-01-18 09:07:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205482  77 58501 32848181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:07:28 [DEBUG   ] Got command RPT from MCS: ref #1205484
2019-01-18 09:07:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205484  12 58501 32848385 A  ERRORB™™š'
2019-01-18 09:07:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:07:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:08:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:08:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:08:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:08:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:08:11 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-18 09:08:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 09:08:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:08:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:09:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:09:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:09:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:09:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:09:11 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-18 09:09:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 09:09:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 09:09:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:10:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:10:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:10:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:10:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:10:11 [WARNING ] (13, 1, 'bot')
2019-01-18 09:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:10:11 [DEBUG   ] Finished updating board flags in 1.514 seconds
2019-01-18 09:10:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 09:10:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:10:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 09:11:05 [DEBUG   ] Got command RPT from MCS: ref #1205492
2019-01-18 09:11:05 [DEBUG   ] summary = ERROR
2019-01-18 09:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205492  13 58501 33065921 A  ERRORERROR'
2019-01-18 09:11:05 [DEBUG   ] Got command RPT from MCS: ref #1205493
2019-01-18 09:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205493  77 58501 33065922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:11:12 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-01-18 09:11:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:11:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:11:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:11:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:11:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:11:12 [DEBUG   ] Finished updating board flags in 2.224 seconds
2019-01-18 09:11:32 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2019-01-18 09:11:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-18 09:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:12:12 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-01-18 09:12:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:12:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:12:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:12:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:12:12 [DEBUG   ] Finished updating board flags in 2.186 seconds
2019-01-18 09:12:27 [DEBUG   ] Got command RPT from MCS: ref #1205509
2019-01-18 09:12:27 [DEBUG   ] summary = ERROR
2019-01-18 09:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205509  13 58501 33147661 A  ERRORERROR'
2019-01-18 09:12:27 [DEBUG   ] Got command RPT from MCS: ref #1205510
2019-01-18 09:12:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205510  77 58501 33147865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:12:28 [DEBUG   ] Got command RPT from MCS: ref #1205511
2019-01-18 09:12:28 [DEBUG   ] summary = ERROR
2019-01-18 09:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205511  13 58501 33148069 A  ERRORERROR'
2019-01-18 09:12:28 [DEBUG   ] Got command RPT from MCS: ref #1205512
2019-01-18 09:12:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205512  77 58501 33148273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:12:28 [DEBUG   ] Got command RPT from MCS: ref #1205513
2019-01-18 09:12:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205513  12 58501 33148465 A  ERRORB˜™š'
2019-01-18 09:12:32 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-01-18 09:12:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 09:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:13:12 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-01-18 09:13:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:13:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:13:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:13:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:13:12 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-18 09:13:32 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2019-01-18 09:13:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-18 09:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:14:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:14:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:14:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:14:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:14:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:14:12 [DEBUG   ] Finished updating board flags in 2.022 seconds
2019-01-18 09:14:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 09:14:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:14:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:15:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:15:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:15:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:15:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:15:12 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-18 09:15:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:15:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:15:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:16:05 [DEBUG   ] Got command RPT from MCS: ref #1205522
2019-01-18 09:16:05 [DEBUG   ] summary = ERROR
2019-01-18 09:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205522  13 58501 33365913 A  ERRORERROR'
2019-01-18 09:16:05 [DEBUG   ] Got command RPT from MCS: ref #1205523
2019-01-18 09:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205523  77 58501 33365914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:16:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:16:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:16:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:16:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:16:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:16:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:16:12 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-18 09:16:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:16:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:16:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:17:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:17:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:17:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:17:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:17:12 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-18 09:17:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:17:27 [DEBUG   ] Got command RPT from MCS: ref #1205541
2019-01-18 09:17:27 [DEBUG   ] summary = ERROR
2019-01-18 09:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205541  13 58501 33447749 A  ERRORERROR'
2019-01-18 09:17:27 [DEBUG   ] Got command RPT from MCS: ref #1205542
2019-01-18 09:17:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205542  77 58501 33447941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:17:28 [DEBUG   ] Got command RPT from MCS: ref #1205543
2019-01-18 09:17:28 [DEBUG   ] summary = ERROR
2019-01-18 09:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205543  13 58501 33448145 A  ERRORERROR'
2019-01-18 09:17:28 [DEBUG   ] Got command RPT from MCS: ref #1205545
2019-01-18 09:17:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205545  77 58501 33448349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:17:28 [DEBUG   ] Got command RPT from MCS: ref #1205546
2019-01-18 09:17:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205546  12 58501 33448553 A  ERRORB˜™š'
2019-01-18 09:17:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:17:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:18:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 09:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:18:13 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2019-01-18 09:18:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:18:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:18:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:18:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:18:13 [DEBUG   ] Finished updating board flags in 2.693 seconds
2019-01-18 09:18:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 09:18:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 09:19:11 [DEBUG   ] Got command TBW from MCS: ref #1205556
2019-01-18 09:19:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-18 09:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1205556   8 58501 33551893 A  ERROR'
2019-01-18 09:19:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:19:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:19:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:19:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:19:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:19:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:19:12 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-18 09:19:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-18 09:19:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-18 09:19:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-18 09:19:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-18 09:19:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-18 09:19:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-18 09:19:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-18 09:19:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-18 09:19:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-18 09:19:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-18 09:19:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-18 09:19:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-18 09:19:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-18 09:19:15 [DEBUG   ] spawn_process: at 2019-01-18 09:19:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-18 09:19:15 [INFO    ] Finished spawning TBW
2019-01-18 09:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:20:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:20:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:20:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:20:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:20:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:20:12 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-01-18 09:21:03 [INFO    ] __waitForTBW - TBW finished in 108.368 s
2019-01-18 09:21:04 [DEBUG   ] Finished updating ant stats in 0.480 seconds
2019-01-18 09:21:04 [INFO    ] Started antennas statistics background thread
2019-01-18 09:21:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547803266']
2019-01-18 09:21:04 [DEBUG   ] spawn_process: at 2019-01-18 09:21:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547803266']
2019-01-18 09:21:04 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-18 09:21:05 [DEBUG   ] Got command RPT from MCS: ref #1205561
2019-01-18 09:21:05 [DEBUG   ] summary = ERROR
2019-01-18 09:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205561  13 58501 33665921 A  ERRORERROR'
2019-01-18 09:21:05 [DEBUG   ] Got command RPT from MCS: ref #1205562
2019-01-18 09:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205562  77 58501 33665922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:21:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:21:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:21:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:21:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:21:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:21:12 [DEBUG   ] Finished updating board flags in 1.485 seconds
2019-01-18 09:21:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2019-01-18 09:21:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 09:22:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 09:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:22:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:22:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:22:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:22:12 [WARNING ] (13, 1, 'bot')
2019-01-18 09:22:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:22:12 [DEBUG   ] Finished updating board flags in 1.500 seconds
2019-01-18 09:22:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 09:22:27 [DEBUG   ] Got command RPT from MCS: ref #1205585
2019-01-18 09:22:27 [DEBUG   ] summary = ERROR
2019-01-18 09:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205585  13 58501 33747829 A  ERRORERROR'
2019-01-18 09:22:28 [DEBUG   ] Got command RPT from MCS: ref #1205586
2019-01-18 09:22:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205586  77 58501 33748021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:22:28 [DEBUG   ] Got command RPT from MCS: ref #1205587
2019-01-18 09:22:28 [DEBUG   ] summary = ERROR
2019-01-18 09:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205587  13 58501 33748225 A  ERRORERROR'
2019-01-18 09:22:28 [DEBUG   ] Got command RPT from MCS: ref #1205588
2019-01-18 09:22:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205588  77 58501 33748429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:22:28 [DEBUG   ] Got command RPT from MCS: ref #1205589
2019-01-18 09:22:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205589  12 58501 33748633 A  ERRORB™™š'
2019-01-18 09:22:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:23:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:23:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:23:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:23:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:23:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:23:13 [DEBUG   ] Finished updating board flags in 2.214 seconds
2019-01-18 09:23:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:23:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 09:24:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:24:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:24:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:24:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:24:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:24:13 [DEBUG   ] Finished updating board flags in 2.127 seconds
2019-01-18 09:24:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:24:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:25:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 09:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:25:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:25:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:25:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:25:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:25:13 [DEBUG   ] Finished updating board flags in 2.083 seconds
2019-01-18 09:25:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:25:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 09:26:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 09:26:05 [DEBUG   ] Got command RPT from MCS: ref #1205594
2019-01-18 09:26:05 [DEBUG   ] summary = ERROR
2019-01-18 09:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205594  13 58501 33965917 A  ERRORERROR'
2019-01-18 09:26:05 [DEBUG   ] Got command RPT from MCS: ref #1205595
2019-01-18 09:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205595  77 58501 33965918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 09:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:26:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:26:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:26:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:26:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:26:13 [DEBUG   ] Finished updating board flags in 1.923 seconds
2019-01-18 09:26:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:26:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:27:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 09:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:27:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:27:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:27:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:27:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:27:13 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-18 09:27:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 09:27:27 [DEBUG   ] Got command RPT from MCS: ref #1205613
2019-01-18 09:27:27 [DEBUG   ] summary = ERROR
2019-01-18 09:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205613  13 58501 34047901 A  ERRORERROR'
2019-01-18 09:27:28 [DEBUG   ] Got command RPT from MCS: ref #1205614
2019-01-18 09:27:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205614  77 58501 34048105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:27:28 [DEBUG   ] Got command RPT from MCS: ref #1205615
2019-01-18 09:27:28 [DEBUG   ] summary = ERROR
2019-01-18 09:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205615  13 58501 34048309 A  ERRORERROR'
2019-01-18 09:27:28 [DEBUG   ] Got command RPT from MCS: ref #1205617
2019-01-18 09:27:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205617  77 58501 34048513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:27:28 [DEBUG   ] Got command RPT from MCS: ref #1205618
2019-01-18 09:27:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205618  12 58501 34048705 A  ERRORB˜™š'
2019-01-18 09:27:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:28:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:28:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:28:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:28:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:28:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:28:13 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-18 09:28:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 09:28:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 09:29:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:29:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:29:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:29:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:29:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:29:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:29:13 [DEBUG   ] Finished updating board flags in 1.667 seconds
2019-01-18 09:29:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:29:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 09:30:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 09:30:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-18 09:30:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:30:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:30:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:30:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:30:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:30:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:30:13 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-18 09:30:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:30:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 09:31:05 [DEBUG   ] Got command RPT from MCS: ref #1205631
2019-01-18 09:31:05 [DEBUG   ] summary = ERROR
2019-01-18 09:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205631  13 58501 34265917 A  ERRORERROR'
2019-01-18 09:31:05 [DEBUG   ] Got command RPT from MCS: ref #1205632
2019-01-18 09:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205632  77 58501 34265918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:31:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 09:31:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 09:31:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:31:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:31:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:31:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:31:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:31:13 [DEBUG   ] Finished updating board flags in 1.535 seconds
2019-01-18 09:31:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 09:31:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:32:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:32:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:32:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:32:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:32:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:32:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:32:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:32:13 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-01-18 09:32:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 09:32:27 [DEBUG   ] Got command RPT from MCS: ref #1205648
2019-01-18 09:32:27 [DEBUG   ] summary = ERROR
2019-01-18 09:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205648  13 58501 34347981 A  ERRORERROR'
2019-01-18 09:32:28 [DEBUG   ] Got command RPT from MCS: ref #1205649
2019-01-18 09:32:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205649  77 58501 34348185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:32:28 [DEBUG   ] Got command RPT from MCS: ref #1205650
2019-01-18 09:32:28 [DEBUG   ] summary = ERROR
2019-01-18 09:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205650  13 58501 34348389 A  ERRORERROR'
2019-01-18 09:32:28 [DEBUG   ] Got command RPT from MCS: ref #1205651
2019-01-18 09:32:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205651  77 58501 34348593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:32:28 [DEBUG   ] Got command RPT from MCS: ref #1205652
2019-01-18 09:32:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205652  12 58501 34348785 A  ERRORB™™š'
2019-01-18 09:32:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:33:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:33:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:33:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:33:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:33:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:33:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:33:13 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-01-18 09:33:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 09:33:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-18 09:34:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:34:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 09:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:34:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:34:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:34:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:34:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:34:13 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-18 09:34:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 09:34:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 09:35:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 09:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:35:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:35:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:35:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:35:13 [WARNING ] (13, 1, 'bot')
2019-01-18 09:35:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:35:13 [DEBUG   ] Finished updating board flags in 1.531 seconds
2019-01-18 09:35:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:35:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 09:36:05 [DEBUG   ] Got command RPT from MCS: ref #1205657
2019-01-18 09:36:05 [DEBUG   ] summary = ERROR
2019-01-18 09:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205657  13 58501 34565921 A  ERRORERROR'
2019-01-18 09:36:05 [DEBUG   ] Got command RPT from MCS: ref #1205658
2019-01-18 09:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205658  77 58501 34565922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:36:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 09:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:36:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:36:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 09:36:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:36:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:36:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:36:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:36:14 [DEBUG   ] Finished updating board flags in 2.223 seconds
2019-01-18 09:36:26 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 09:36:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-18 09:37:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-18 09:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:37:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:37:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:37:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:37:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:37:14 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-01-18 09:37:27 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-18 09:37:28 [DEBUG   ] Got command RPT from MCS: ref #1205680
2019-01-18 09:37:28 [DEBUG   ] summary = ERROR
2019-01-18 09:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205680  13 58501 34648069 A  ERRORERROR'
2019-01-18 09:37:28 [DEBUG   ] Got command RPT from MCS: ref #1205681
2019-01-18 09:37:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205681  77 58501 34648261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:37:28 [DEBUG   ] Got command RPT from MCS: ref #1205682
2019-01-18 09:37:28 [DEBUG   ] summary = ERROR
2019-01-18 09:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205682  13 58501 34648465 A  ERRORERROR'
2019-01-18 09:37:28 [DEBUG   ] Got command RPT from MCS: ref #1205684
2019-01-18 09:37:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205684  77 58501 34648669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:37:28 [DEBUG   ] Got command RPT from MCS: ref #1205685
2019-01-18 09:37:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205685  12 58501 34648873 A  ERRORB™™š'
2019-01-18 09:37:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 09:38:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:38:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 09:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:38:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:38:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:38:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:38:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:38:14 [DEBUG   ] Finished updating board flags in 2.131 seconds
2019-01-18 09:38:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:38:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:39:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:39:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:39:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:39:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:39:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:39:14 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-18 09:39:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:39:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:40:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:40:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 09:40:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 09:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:40:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 09:40:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:40:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:40:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:40:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:40:14 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-18 09:40:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:40:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:41:05 [DEBUG   ] Got command RPT from MCS: ref #1205694
2019-01-18 09:41:05 [DEBUG   ] summary = ERROR
2019-01-18 09:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205694  13 58501 34865925 A  ERRORERROR'
2019-01-18 09:41:05 [DEBUG   ] Got command RPT from MCS: ref #1205695
2019-01-18 09:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205695  77 58501 34865926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:41:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:41:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 09:41:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:41:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:41:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:41:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:41:14 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-18 09:41:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:41:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:42:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:42:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:42:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:42:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:42:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:42:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:42:14 [DEBUG   ] Finished updating board flags in 1.885 seconds
2019-01-18 09:42:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:42:28 [DEBUG   ] Got command RPT from MCS: ref #1205711
2019-01-18 09:42:28 [DEBUG   ] summary = ERROR
2019-01-18 09:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205711  13 58501 34948145 A  ERRORERROR'
2019-01-18 09:42:28 [DEBUG   ] Got command RPT from MCS: ref #1205712
2019-01-18 09:42:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205712  77 58501 34948349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:42:28 [DEBUG   ] Got command RPT from MCS: ref #1205713
2019-01-18 09:42:28 [DEBUG   ] summary = ERROR
2019-01-18 09:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205713  13 58501 34948553 A  ERRORERROR'
2019-01-18 09:42:28 [DEBUG   ] Got command RPT from MCS: ref #1205714
2019-01-18 09:42:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205714  77 58501 34948745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:42:28 [DEBUG   ] Got command RPT from MCS: ref #1205715
2019-01-18 09:42:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205715  12 58501 34948949 A  ERRORB™™š'
2019-01-18 09:42:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 09:43:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:43:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:43:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:43:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:43:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:43:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:43:14 [DEBUG   ] Finished updating board flags in 1.714 seconds
2019-01-18 09:43:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:43:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 09:44:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 09:44:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:44:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:44:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:44:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:44:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:44:14 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-18 09:44:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 09:44:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:45:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:45:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 09:45:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:45:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:45:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:45:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:45:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:45:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:45:14 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-18 09:45:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:45:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:46:05 [DEBUG   ] Got command RPT from MCS: ref #1205724
2019-01-18 09:46:05 [DEBUG   ] summary = ERROR
2019-01-18 09:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205724  13 58501 35165921 A  ERRORERROR'
2019-01-18 09:46:05 [DEBUG   ] Got command RPT from MCS: ref #1205725
2019-01-18 09:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205725  77 58501 35165922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:46:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 09:46:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:46:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:46:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:46:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:46:14 [WARNING ] (13, 1, 'bot')
2019-01-18 09:46:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:46:14 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-18 09:46:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 09:46:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:47:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 09:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:47:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:47:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:47:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:47:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:47:15 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-01-18 09:47:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 09:47:28 [DEBUG   ] Got command RPT from MCS: ref #1205743
2019-01-18 09:47:28 [DEBUG   ] summary = ERROR
2019-01-18 09:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205743  13 58501 35248229 A  ERRORERROR'
2019-01-18 09:47:28 [DEBUG   ] Got command RPT from MCS: ref #1205744
2019-01-18 09:47:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205744  77 58501 35248433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:47:28 [DEBUG   ] Got command RPT from MCS: ref #1205745
2019-01-18 09:47:28 [DEBUG   ] summary = ERROR
2019-01-18 09:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205745  13 58501 35248625 A  ERRORERROR'
2019-01-18 09:47:28 [DEBUG   ] Got command RPT from MCS: ref #1205747
2019-01-18 09:47:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205747  77 58501 35248829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:47:29 [DEBUG   ] Got command RPT from MCS: ref #1205748
2019-01-18 09:47:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205748  12 58501 35249033 A  ERRORB™™š'
2019-01-18 09:47:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 09:48:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:48:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:48:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:48:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:48:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:48:15 [DEBUG   ] Finished updating board flags in 2.177 seconds
2019-01-18 09:48:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 09:48:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 09:49:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 09:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:49:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:49:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:49:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:49:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:49:15 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-18 09:49:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:49:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:50:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 09:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:50:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:50:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:50:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:50:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:50:15 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-01-18 09:50:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:50:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:51:05 [DEBUG   ] Got command RPT from MCS: ref #1205757
2019-01-18 09:51:05 [DEBUG   ] summary = ERROR
2019-01-18 09:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205757  13 58501 35465925 A  ERRORERROR'
2019-01-18 09:51:05 [DEBUG   ] Got command RPT from MCS: ref #1205758
2019-01-18 09:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205758  77 58501 35465926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:51:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:51:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:51:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:51:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:51:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:51:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:51:15 [DEBUG   ] Finished updating board flags in 1.916 seconds
2019-01-18 09:51:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 09:51:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 09:52:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 09:52:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:52:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:52:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:52:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:52:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:52:15 [DEBUG   ] Finished updating board flags in 1.709 seconds
2019-01-18 09:52:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 09:52:28 [DEBUG   ] Got command RPT from MCS: ref #1205778
2019-01-18 09:52:28 [DEBUG   ] summary = ERROR
2019-01-18 09:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205778  13 58501 35548309 A  ERRORERROR'
2019-01-18 09:52:28 [DEBUG   ] Got command RPT from MCS: ref #1205779
2019-01-18 09:52:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205779  77 58501 35548513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:52:28 [DEBUG   ] Got command RPT from MCS: ref #1205780
2019-01-18 09:52:28 [DEBUG   ] summary = ERROR
2019-01-18 09:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205780  13 58501 35548705 A  ERRORERROR'
2019-01-18 09:52:28 [DEBUG   ] Got command RPT from MCS: ref #1205781
2019-01-18 09:52:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205781  77 58501 35548909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:52:29 [DEBUG   ] Got command RPT from MCS: ref #1205782
2019-01-18 09:52:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205782  12 58501 35549113 A  ERRORB˜™š'
2019-01-18 09:52:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 09:53:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 09:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:53:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:53:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:53:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:53:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:53:15 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-18 09:53:28 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-18 09:53:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 09:54:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:54:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:54:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:54:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:54:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:54:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:54:15 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-18 09:54:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:54:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:55:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:55:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:55:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:55:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:55:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:55:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:55:15 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-18 09:55:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:55:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:56:05 [DEBUG   ] Got command RPT from MCS: ref #1205787
2019-01-18 09:56:05 [DEBUG   ] summary = ERROR
2019-01-18 09:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205787  13 58501 35765925 A  ERRORERROR'
2019-01-18 09:56:05 [DEBUG   ] Got command RPT from MCS: ref #1205788
2019-01-18 09:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205788  77 58501 35765926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:56:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:56:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:56:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:56:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:56:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:56:15 [WARNING ] (13, 1, 'bot')
2019-01-18 09:56:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:56:15 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-18 09:56:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:56:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:57:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:57:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:57:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:57:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:57:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:57:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:57:16 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-18 09:57:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:57:28 [DEBUG   ] Got command RPT from MCS: ref #1205806
2019-01-18 09:57:28 [DEBUG   ] summary = ERROR
2019-01-18 09:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205806  13 58501 35848385 A  ERRORERROR'
2019-01-18 09:57:28 [DEBUG   ] Got command RPT from MCS: ref #1205807
2019-01-18 09:57:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205807  77 58501 35848589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:57:28 [DEBUG   ] Got command RPT from MCS: ref #1205808
2019-01-18 09:57:28 [DEBUG   ] summary = ERROR
2019-01-18 09:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205808  13 58501 35848793 A  ERRORERROR'
2019-01-18 09:57:28 [DEBUG   ] Got command RPT from MCS: ref #1205810
2019-01-18 09:57:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 09:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205810  77 58501 35848997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 09:57:29 [DEBUG   ] Got command RPT from MCS: ref #1205811
2019-01-18 09:57:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 09:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205811  12 58501 35849189 A  ERRORB™™š'
2019-01-18 09:57:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:58:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:58:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:58:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:58:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:58:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:58:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:58:16 [DEBUG   ] Finished updating board flags in 2.214 seconds
2019-01-18 09:58:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 09:58:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 09:59:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 09:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 09:59:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:59:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:59:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:59:16 [WARNING ] (13, 1, 'bot')
2019-01-18 09:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 09:59:16 [DEBUG   ] Finished updating board flags in 2.277 seconds
2019-01-18 09:59:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 09:59:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:00:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:00:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:00:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:00:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:00:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:00:16 [DEBUG   ] Finished updating board flags in 2.117 seconds
2019-01-18 10:00:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:00:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:01:05 [DEBUG   ] Got command RPT from MCS: ref #1205824
2019-01-18 10:01:05 [DEBUG   ] summary = ERROR
2019-01-18 10:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205824  13 58501 36065925 A  ERRORERROR'
2019-01-18 10:01:05 [DEBUG   ] Got command RPT from MCS: ref #1205825
2019-01-18 10:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205825  77 58501 36065926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:01:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:01:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:01:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:01:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:01:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:01:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:01:16 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-18 10:01:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:01:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 10:02:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 10:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:02:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:02:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:02:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:02:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:02:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:02:16 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-18 10:02:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 10:02:28 [DEBUG   ] Got command RPT from MCS: ref #1205841
2019-01-18 10:02:28 [DEBUG   ] summary = ERROR
2019-01-18 10:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205841  13 58501 36148473 A  ERRORERROR'
2019-01-18 10:02:28 [DEBUG   ] Got command RPT from MCS: ref #1205842
2019-01-18 10:02:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205842  77 58501 36148677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:02:28 [DEBUG   ] Got command RPT from MCS: ref #1205843
2019-01-18 10:02:28 [DEBUG   ] summary = ERROR
2019-01-18 10:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205843  13 58501 36148869 A  ERRORERROR'
2019-01-18 10:02:29 [DEBUG   ] Got command RPT from MCS: ref #1205844
2019-01-18 10:02:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205844  77 58501 36149073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:02:29 [DEBUG   ] Got command RPT from MCS: ref #1205845
2019-01-18 10:02:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205845  12 58501 36149277 A  ERRORB™™š'
2019-01-18 10:02:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:03:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:03:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:03:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:03:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:03:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:03:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:03:16 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-18 10:03:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:03:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:04:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:04:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:04:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:04:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:04:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:04:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:04:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:04:16 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-18 10:04:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:04:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:05:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 10:05:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:05:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:05:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:05:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:05:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:05:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:05:16 [DEBUG   ] Finished updating board flags in 1.654 seconds
2019-01-18 10:05:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:05:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:06:05 [DEBUG   ] Got command RPT from MCS: ref #1205850
2019-01-18 10:06:05 [DEBUG   ] summary = ERROR
2019-01-18 10:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205850  13 58501 36365929 A  ERRORERROR'
2019-01-18 10:06:05 [DEBUG   ] Got command RPT from MCS: ref #1205851
2019-01-18 10:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205851  77 58501 36365930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:06:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:06:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 10:06:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:06:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:06:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:06:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:06:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:06:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:06:16 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-18 10:06:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:06:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:07:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:07:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:07:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:07:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:07:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:07:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:07:16 [DEBUG   ] Finished updating board flags in 1.526 seconds
2019-01-18 10:07:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:07:28 [DEBUG   ] Got command RPT from MCS: ref #1205873
2019-01-18 10:07:28 [DEBUG   ] summary = ERROR
2019-01-18 10:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205873  13 58501 36448549 A  ERRORERROR'
2019-01-18 10:07:28 [DEBUG   ] Got command RPT from MCS: ref #1205874
2019-01-18 10:07:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205874  77 58501 36448753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:07:28 [DEBUG   ] Got command RPT from MCS: ref #1205875
2019-01-18 10:07:28 [DEBUG   ] summary = ERROR
2019-01-18 10:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205875  13 58501 36448957 A  ERRORERROR'
2019-01-18 10:07:29 [DEBUG   ] Got command RPT from MCS: ref #1205877
2019-01-18 10:07:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205877  77 58501 36449149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:07:29 [DEBUG   ] Got command RPT from MCS: ref #1205878
2019-01-18 10:07:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205878  12 58501 36449353 A  ERRORB™™š'
2019-01-18 10:07:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:08:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:08:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 10:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:08:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:08:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:08:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:08:16 [WARNING ] (13, 1, 'bot')
2019-01-18 10:08:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:08:16 [DEBUG   ] Finished updating board flags in 1.531 seconds
2019-01-18 10:08:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:08:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:09:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:09:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:09:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:09:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:09:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:09:17 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-01-18 10:09:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 10:09:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 10:10:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:10:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:10:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:10:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:10:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:10:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:10:17 [DEBUG   ] Finished updating board flags in 2.065 seconds
2019-01-18 10:10:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 10:10:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:11:05 [DEBUG   ] Got command RPT from MCS: ref #1205887
2019-01-18 10:11:05 [DEBUG   ] summary = ERROR
2019-01-18 10:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205887  13 58501 36665929 A  ERRORERROR'
2019-01-18 10:11:05 [DEBUG   ] Got command RPT from MCS: ref #1205888
2019-01-18 10:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205888  77 58501 36665930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:11:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:11:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:11:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:11:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:11:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:11:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:11:17 [DEBUG   ] Finished updating board flags in 1.872 seconds
2019-01-18 10:11:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:11:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:12:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:12:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:12:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:12:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:12:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:12:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:12:17 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-18 10:12:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 10:12:28 [DEBUG   ] Got command RPT from MCS: ref #1205904
2019-01-18 10:12:28 [DEBUG   ] summary = ERROR
2019-01-18 10:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205904  13 58501 36748633 A  ERRORERROR'
2019-01-18 10:12:28 [DEBUG   ] Got command RPT from MCS: ref #1205905
2019-01-18 10:12:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205905  77 58501 36748825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:12:29 [DEBUG   ] Got command RPT from MCS: ref #1205906
2019-01-18 10:12:29 [DEBUG   ] summary = ERROR
2019-01-18 10:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205906  13 58501 36749029 A  ERRORERROR'
2019-01-18 10:12:29 [DEBUG   ] Got command RPT from MCS: ref #1205907
2019-01-18 10:12:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205907  77 58501 36749233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:12:29 [DEBUG   ] Got command RPT from MCS: ref #1205908
2019-01-18 10:12:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205908  12 58501 36749437 A  ERRORB™™š'
2019-01-18 10:12:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 10:13:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 10:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:13:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:13:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:13:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:13:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:13:17 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-18 10:13:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 10:13:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 10:14:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:14:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:14:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:14:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:14:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:14:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:14:17 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-18 10:14:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:14:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:15:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 10:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:15:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:15:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:15:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:15:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:15:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:15:17 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-18 10:15:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 10:15:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 10:16:05 [DEBUG   ] Got command RPT from MCS: ref #1205917
2019-01-18 10:16:05 [DEBUG   ] summary = ERROR
2019-01-18 10:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205917  13 58501 36965929 A  ERRORERROR'
2019-01-18 10:16:05 [DEBUG   ] Got command RPT from MCS: ref #1205918
2019-01-18 10:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205918  77 58501 36965930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:16:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 10:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:16:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:16:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:16:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:16:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:16:17 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-18 10:16:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 10:16:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:17:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:17:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:17:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:17:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:17:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:17:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:17:17 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-18 10:17:28 [DEBUG   ] Got command RPT from MCS: ref #1205936
2019-01-18 10:17:28 [DEBUG   ] summary = ERROR
2019-01-18 10:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205936  13 58501 37048709 A  ERRORERROR'
2019-01-18 10:17:28 [DEBUG   ] Got command RPT from MCS: ref #1205937
2019-01-18 10:17:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205937  77 58501 37048914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:17:29 [DEBUG   ] Got command RPT from MCS: ref #1205938
2019-01-18 10:17:29 [DEBUG   ] summary = ERROR
2019-01-18 10:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205938  13 58501 37049117 A  ERRORERROR'
2019-01-18 10:17:29 [DEBUG   ] Got command RPT from MCS: ref #1205940
2019-01-18 10:17:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205940  77 58501 37049310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:17:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:17:29 [DEBUG   ] Got command RPT from MCS: ref #1205941
2019-01-18 10:17:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205941  12 58501 37049513 A  ERRORB˜™š'
2019-01-18 10:17:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:18:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:18:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:18:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:18:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:18:17 [WARNING ] (13, 1, 'bot')
2019-01-18 10:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:18:17 [DEBUG   ] Finished updating board flags in 1.556 seconds
2019-01-18 10:18:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:18:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:19:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:19:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:19:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:19:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:19:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:19:18 [DEBUG   ] Finished updating board flags in 2.164 seconds
2019-01-18 10:19:29 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 10:19:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:20:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 10:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:20:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:20:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:20:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:20:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:20:18 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-18 10:20:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:20:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:21:05 [DEBUG   ] Got command RPT from MCS: ref #1205950
2019-01-18 10:21:05 [DEBUG   ] summary = ERROR
2019-01-18 10:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205950  13 58501 37265937 A  ERRORERROR'
2019-01-18 10:21:05 [DEBUG   ] Got command RPT from MCS: ref #1205951
2019-01-18 10:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205951  77 58501 37265938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:21:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:21:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-18 10:21:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:21:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:21:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:21:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:21:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:21:18 [DEBUG   ] Finished updating board flags in 1.713 seconds
2019-01-18 10:21:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:21:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:22:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:22:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:22:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:22:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:22:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:22:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:22:18 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-18 10:22:28 [DEBUG   ] Got command RPT from MCS: ref #1205971
2019-01-18 10:22:28 [DEBUG   ] summary = ERROR
2019-01-18 10:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205971  13 58501 37348789 A  ERRORERROR'
2019-01-18 10:22:28 [DEBUG   ] Got command RPT from MCS: ref #1205972
2019-01-18 10:22:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205972  77 58501 37348993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:22:29 [DEBUG   ] Got command RPT from MCS: ref #1205973
2019-01-18 10:22:29 [DEBUG   ] summary = ERROR
2019-01-18 10:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205973  13 58501 37349197 A  ERRORERROR'
2019-01-18 10:22:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:22:29 [DEBUG   ] Got command RPT from MCS: ref #1205974
2019-01-18 10:22:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205974  77 58501 37349389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:22:29 [DEBUG   ] Got command RPT from MCS: ref #1205975
2019-01-18 10:22:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205975  12 58501 37349593 A  ERRORB˜™š'
2019-01-18 10:22:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 10:23:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:23:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:23:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:23:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:23:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:23:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:23:18 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-18 10:23:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 10:23:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:24:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 10:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:24:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:24:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:24:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:24:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:24:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:24:18 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-01-18 10:24:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:24:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 10:25:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:25:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 10:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:25:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:25:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:25:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:25:18 [WARNING ] (13, 1, 'bot')
2019-01-18 10:25:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:25:18 [DEBUG   ] Finished updating board flags in 1.550 seconds
2019-01-18 10:25:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 10:25:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:26:05 [DEBUG   ] Got command RPT from MCS: ref #1205980
2019-01-18 10:26:05 [DEBUG   ] summary = ERROR
2019-01-18 10:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205980  13 58501 37565929 A  ERRORERROR'
2019-01-18 10:26:05 [DEBUG   ] Got command RPT from MCS: ref #1205981
2019-01-18 10:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205981  77 58501 37565930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:26:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:26:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:26:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:26:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:26:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:26:19 [DEBUG   ] Finished updating board flags in 2.261 seconds
2019-01-18 10:26:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 10:26:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 10:27:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:27:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:27:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:27:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:27:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:27:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:27:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:27:19 [DEBUG   ] Finished updating board flags in 2.091 seconds
2019-01-18 10:27:28 [DEBUG   ] Got command RPT from MCS: ref #1205999
2019-01-18 10:27:28 [DEBUG   ] summary = ERROR
2019-01-18 10:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1205999  13 58501 37648873 A  ERRORERROR'
2019-01-18 10:27:29 [DEBUG   ] Got command RPT from MCS: ref #1206000
2019-01-18 10:27:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206000  77 58501 37649077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:27:29 [DEBUG   ] Got command RPT from MCS: ref #1206001
2019-01-18 10:27:29 [DEBUG   ] summary = ERROR
2019-01-18 10:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206001  13 58501 37649269 A  ERRORERROR'
2019-01-18 10:27:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:27:29 [DEBUG   ] Got command RPT from MCS: ref #1206002
2019-01-18 10:27:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206002  77 58501 37649473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:27:29 [DEBUG   ] Got command RPT from MCS: ref #1206004
2019-01-18 10:27:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206004  12 58501 37649677 A  ERRORB™™š'
2019-01-18 10:27:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:28:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:28:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:28:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:28:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:28:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:28:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:28:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:28:19 [DEBUG   ] Finished updating board flags in 2.044 seconds
2019-01-18 10:28:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:28:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:29:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 10:29:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:29:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:29:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:29:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:29:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:29:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:29:19 [DEBUG   ] Finished updating board flags in 1.973 seconds
2019-01-18 10:29:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 10:29:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:30:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-18 10:30:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:30:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:30:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:30:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:30:19 [WARNING ] (25, 5, 'bot')
2019-01-18 10:30:19 [WARNING ] (25, 5, 'bot')
2019-01-18 10:30:19 [WARNING ] (25, 5, 'bot')
2019-01-18 10:30:19 [WARNING ] (25, 5, 'bot')
2019-01-18 10:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:30:19 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-18 10:30:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:30:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:31:05 [DEBUG   ] Got command RPT from MCS: ref #1206017
2019-01-18 10:31:05 [DEBUG   ] summary = ERROR
2019-01-18 10:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206017  13 58501 37865929 A  ERRORERROR'
2019-01-18 10:31:05 [DEBUG   ] Got command RPT from MCS: ref #1206018
2019-01-18 10:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206018  77 58501 37865930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:31:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:31:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 10:31:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:31:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:31:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:31:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:31:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:31:19 [DEBUG   ] Finished updating board flags in 1.651 seconds
2019-01-18 10:31:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:31:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:32:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:32:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:32:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:32:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:32:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:32:19 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-01-18 10:32:28 [DEBUG   ] Got command RPT from MCS: ref #1206034
2019-01-18 10:32:28 [DEBUG   ] summary = ERROR
2019-01-18 10:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206034  13 58501 37948949 A  ERRORERROR'
2019-01-18 10:32:29 [DEBUG   ] Got command RPT from MCS: ref #1206035
2019-01-18 10:32:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206035  77 58501 37949153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:32:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:32:29 [DEBUG   ] Got command RPT from MCS: ref #1206036
2019-01-18 10:32:29 [DEBUG   ] summary = ERROR
2019-01-18 10:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206036  13 58501 37949357 A  ERRORERROR'
2019-01-18 10:32:29 [DEBUG   ] Got command RPT from MCS: ref #1206037
2019-01-18 10:32:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206037  77 58501 37949549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:32:29 [DEBUG   ] Got command RPT from MCS: ref #1206038
2019-01-18 10:32:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206038  12 58501 37949753 A  ERRORB˜™š'
2019-01-18 10:32:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:33:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:33:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 10:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:33:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:33:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:33:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:33:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:33:19 [DEBUG   ] Finished updating board flags in 1.523 seconds
2019-01-18 10:33:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 10:33:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:34:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 10:34:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 10:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:34:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:34:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:34:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:34:19 [WARNING ] (13, 1, 'bot')
2019-01-18 10:34:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:34:19 [DEBUG   ] Finished updating board flags in 1.562 seconds
2019-01-18 10:34:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:34:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:35:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:35:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:35:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:35:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:35:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:35:20 [DEBUG   ] Finished updating board flags in 2.196 seconds
2019-01-18 10:35:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 10:35:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 10:36:05 [DEBUG   ] Got command RPT from MCS: ref #1206043
2019-01-18 10:36:05 [DEBUG   ] summary = ERROR
2019-01-18 10:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206043  13 58501 38165941 A  ERRORERROR'
2019-01-18 10:36:05 [DEBUG   ] Got command RPT from MCS: ref #1206044
2019-01-18 10:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206044  77 58501 38165942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:36:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:36:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:36:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:36:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:36:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:36:20 [DEBUG   ] Finished updating board flags in 1.920 seconds
2019-01-18 10:36:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:36:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 10:37:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 10:37:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:37:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:37:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:37:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:37:20 [DEBUG   ] Finished updating board flags in 1.837 seconds
2019-01-18 10:37:29 [DEBUG   ] Got command RPT from MCS: ref #1206066
2019-01-18 10:37:29 [DEBUG   ] summary = ERROR
2019-01-18 10:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206066  13 58501 38249033 A  ERRORERROR'
2019-01-18 10:37:29 [DEBUG   ] Got command RPT from MCS: ref #1206067
2019-01-18 10:37:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206067  77 58501 38249237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:37:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:37:29 [DEBUG   ] Got command RPT from MCS: ref #1206068
2019-01-18 10:37:29 [DEBUG   ] summary = ERROR
2019-01-18 10:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206068  13 58501 38249429 A  ERRORERROR'
2019-01-18 10:37:29 [DEBUG   ] Got command RPT from MCS: ref #1206070
2019-01-18 10:37:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206070  77 58501 38249633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:37:29 [DEBUG   ] Got command RPT from MCS: ref #1206072
2019-01-18 10:37:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206072  12 58501 38249837 A  ERRORB™™š'
2019-01-18 10:37:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:38:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 10:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:38:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:38:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:38:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:38:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:38:20 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-18 10:38:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:38:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 10:39:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 10:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:39:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:39:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:39:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:39:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:39:20 [DEBUG   ] Finished updating board flags in 1.739 seconds
2019-01-18 10:39:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 10:39:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:40:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 10:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:40:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:40:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:40:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:40:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:40:20 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-01-18 10:40:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:40:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 10:41:05 [DEBUG   ] Got command RPT from MCS: ref #1206080
2019-01-18 10:41:05 [DEBUG   ] summary = ERROR
2019-01-18 10:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206080  13 58501 38465937 A  ERRORERROR'
2019-01-18 10:41:05 [DEBUG   ] Got command RPT from MCS: ref #1206081
2019-01-18 10:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206081  77 58501 38465938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:41:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:41:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:41:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:41:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:41:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:41:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:41:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:41:20 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-01-18 10:41:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 10:41:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:42:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 10:42:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:42:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 10:42:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:42:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:42:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:42:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:42:20 [DEBUG   ] Finished updating board flags in 1.629 seconds
2019-01-18 10:42:29 [DEBUG   ] Got command RPT from MCS: ref #1206097
2019-01-18 10:42:29 [DEBUG   ] summary = ERROR
2019-01-18 10:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206097  13 58501 38549117 A  ERRORERROR'
2019-01-18 10:42:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:42:29 [DEBUG   ] Got command RPT from MCS: ref #1206098
2019-01-18 10:42:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206098  77 58501 38549322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:42:29 [DEBUG   ] Got command RPT from MCS: ref #1206099
2019-01-18 10:42:29 [DEBUG   ] summary = ERROR
2019-01-18 10:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206099  13 58501 38549513 A  ERRORERROR'
2019-01-18 10:42:29 [DEBUG   ] Got command RPT from MCS: ref #1206100
2019-01-18 10:42:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206100  77 58501 38549717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:42:29 [DEBUG   ] Got command RPT from MCS: ref #1206101
2019-01-18 10:42:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206101  12 58501 38549921 A  ERRORB™™š'
2019-01-18 10:42:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 10:43:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:43:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:43:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:43:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:43:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:43:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:43:20 [DEBUG   ] Finished updating board flags in 1.634 seconds
2019-01-18 10:43:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 10:43:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 10:44:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 10:44:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:44:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:44:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:44:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:44:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:44:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:44:20 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-01-18 10:44:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 10:44:49 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-01-18 10:45:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 10:45:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 10:45:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:45:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 10:45:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:45:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:45:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:45:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:45:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:45:20 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-01-18 10:45:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:45:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:46:05 [DEBUG   ] Got command RPT from MCS: ref #1206110
2019-01-18 10:46:05 [DEBUG   ] summary = ERROR
2019-01-18 10:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206110  13 58501 38765937 A  ERRORERROR'
2019-01-18 10:46:05 [DEBUG   ] Got command RPT from MCS: ref #1206111
2019-01-18 10:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206111  77 58501 38765938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:46:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:46:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:46:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:46:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:46:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:46:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:46:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:46:20 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-01-18 10:46:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:46:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:47:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:47:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 10:47:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:47:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:47:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:47:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:47:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:47:20 [DEBUG   ] Finished updating board flags in 1.491 seconds
2019-01-18 10:47:29 [DEBUG   ] Got command RPT from MCS: ref #1206129
2019-01-18 10:47:29 [DEBUG   ] summary = ERROR
2019-01-18 10:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206129  13 58501 38849193 A  ERRORERROR'
2019-01-18 10:47:29 [DEBUG   ] Got command RPT from MCS: ref #1206130
2019-01-18 10:47:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206130  77 58501 38849398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:47:29 [DEBUG   ] Got command RPT from MCS: ref #1206131
2019-01-18 10:47:29 [DEBUG   ] summary = ERROR
2019-01-18 10:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206131  13 58501 38849601 A  ERRORERROR'
2019-01-18 10:47:29 [DEBUG   ] Got command RPT from MCS: ref #1206133
2019-01-18 10:47:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206133  77 58501 38849793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:47:29 [DEBUG   ] Got command RPT from MCS: ref #1206135
2019-01-18 10:47:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206135  12 58501 38849997 A  ERRORB™™š'
2019-01-18 10:47:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:47:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 10:48:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:48:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:48:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:48:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:48:20 [WARNING ] (13, 1, 'bot')
2019-01-18 10:48:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:48:20 [DEBUG   ] Finished updating board flags in 1.511 seconds
2019-01-18 10:48:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:48:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:49:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 10:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:49:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:49:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:49:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:49:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:49:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:49:21 [DEBUG   ] Finished updating board flags in 2.264 seconds
2019-01-18 10:49:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:49:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:50:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:50:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 10:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:50:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:50:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:50:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:50:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:50:21 [DEBUG   ] Finished updating board flags in 2.079 seconds
2019-01-18 10:50:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:50:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:51:05 [DEBUG   ] Got command RPT from MCS: ref #1206143
2019-01-18 10:51:05 [DEBUG   ] summary = ERROR
2019-01-18 10:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206143  13 58501 39065933 A  ERRORERROR'
2019-01-18 10:51:05 [DEBUG   ] Got command RPT from MCS: ref #1206144
2019-01-18 10:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206144  77 58501 39065934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:51:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:51:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:51:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:51:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:51:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:51:21 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-18 10:51:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:51:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:52:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:52:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:52:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:52:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:52:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:52:21 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-18 10:52:29 [DEBUG   ] Got command RPT from MCS: ref #1206164
2019-01-18 10:52:29 [DEBUG   ] summary = ERROR
2019-01-18 10:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206164  13 58501 39149277 A  ERRORERROR'
2019-01-18 10:52:29 [DEBUG   ] Got command RPT from MCS: ref #1206165
2019-01-18 10:52:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206165  77 58501 39149481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:52:29 [DEBUG   ] Got command RPT from MCS: ref #1206166
2019-01-18 10:52:29 [DEBUG   ] summary = ERROR
2019-01-18 10:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206166  13 58501 39149673 A  ERRORERROR'
2019-01-18 10:52:29 [DEBUG   ] Got command RPT from MCS: ref #1206167
2019-01-18 10:52:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206167  77 58501 39149877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:52:30 [DEBUG   ] Got command RPT from MCS: ref #1206168
2019-01-18 10:52:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206168  12 58501 39150081 A  ERRORB™™š'
2019-01-18 10:52:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:52:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 10:53:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 10:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:53:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:53:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:53:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:53:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:53:21 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-18 10:53:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 10:53:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 10:54:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:54:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:54:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:54:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:54:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:54:21 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-01-18 10:54:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:54:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:55:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:55:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 10:55:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:55:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:55:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:55:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:55:21 [DEBUG   ] Finished updating board flags in 1.701 seconds
2019-01-18 10:55:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 10:55:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:56:05 [DEBUG   ] Got command RPT from MCS: ref #1206173
2019-01-18 10:56:05 [DEBUG   ] summary = ERROR
2019-01-18 10:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206173  13 58501 39365941 A  ERRORERROR'
2019-01-18 10:56:05 [DEBUG   ] Got command RPT from MCS: ref #1206174
2019-01-18 10:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206174  77 58501 39365942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:56:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 10:56:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:56:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 10:56:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:56:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:56:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:56:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:56:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:56:21 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-18 10:56:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:56:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 10:57:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 10:57:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:57:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:57:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:57:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:57:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:57:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:57:21 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-18 10:57:29 [DEBUG   ] Got command RPT from MCS: ref #1206192
2019-01-18 10:57:29 [DEBUG   ] summary = ERROR
2019-01-18 10:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206192  13 58501 39449362 A  ERRORERROR'
2019-01-18 10:57:29 [DEBUG   ] Got command RPT from MCS: ref #1206193
2019-01-18 10:57:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206193  77 58501 39449554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:57:29 [DEBUG   ] Got command RPT from MCS: ref #1206194
2019-01-18 10:57:29 [DEBUG   ] summary = ERROR
2019-01-18 10:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206194  13 58501 39449761 A  ERRORERROR'
2019-01-18 10:57:29 [DEBUG   ] Got command RPT from MCS: ref #1206196
2019-01-18 10:57:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 10:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206196  77 58501 39449965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 10:57:30 [DEBUG   ] Got command RPT from MCS: ref #1206197
2019-01-18 10:57:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 10:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206197  12 58501 39450157 A  ERRORB˜™š'
2019-01-18 10:57:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-18 10:57:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:58:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:58:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:58:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:58:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:58:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:58:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:58:21 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-01-18 10:58:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 10:58:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 10:59:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 10:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 10:59:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:59:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:59:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:59:21 [WARNING ] (13, 1, 'bot')
2019-01-18 10:59:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 10:59:21 [DEBUG   ] Finished updating board flags in 1.514 seconds
2019-01-18 10:59:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 10:59:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 11:00:10 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-18 11:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:00:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:00:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:00:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:00:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:00:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:00:22 [DEBUG   ] Finished updating board flags in 2.188 seconds
2019-01-18 11:00:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 11:00:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 11:01:05 [DEBUG   ] Got command RPT from MCS: ref #1206210
2019-01-18 11:01:05 [DEBUG   ] summary = ERROR
2019-01-18 11:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206210  13 58501 39665941 A  ERRORERROR'
2019-01-18 11:01:05 [DEBUG   ] Got command RPT from MCS: ref #1206211
2019-01-18 11:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206211  77 58501 39665942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:01:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 11:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:01:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:01:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:01:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:01:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:01:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:01:22 [DEBUG   ] Finished updating board flags in 1.943 seconds
2019-01-18 11:01:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:01:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:02:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:02:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:02:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 11:02:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:02:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:02:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:02:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:02:22 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-18 11:02:29 [DEBUG   ] Got command RPT from MCS: ref #1206227
2019-01-18 11:02:29 [DEBUG   ] summary = ERROR
2019-01-18 11:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206227  13 58501 39749441 A  ERRORERROR'
2019-01-18 11:02:29 [DEBUG   ] Got command RPT from MCS: ref #1206228
2019-01-18 11:02:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206228  77 58501 39749645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:02:29 [DEBUG   ] Got command RPT from MCS: ref #1206229
2019-01-18 11:02:29 [DEBUG   ] summary = ERROR
2019-01-18 11:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206229  13 58501 39749837 A  ERRORERROR'
2019-01-18 11:02:30 [DEBUG   ] Got command RPT from MCS: ref #1206230
2019-01-18 11:02:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206230  77 58501 39750041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:02:30 [DEBUG   ] Got command RPT from MCS: ref #1206231
2019-01-18 11:02:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206231  12 58501 39750245 A  ERRORB™™š'
2019-01-18 11:02:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:02:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:03:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 11:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:03:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:03:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:03:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:03:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:03:22 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-18 11:03:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:03:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:04:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:04:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:04:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:04:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:04:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:04:22 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-18 11:04:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:04:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:05:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:05:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:05:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:05:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:05:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:05:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:05:22 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-18 11:05:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:05:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:06:05 [DEBUG   ] Got command RPT from MCS: ref #1206236
2019-01-18 11:06:05 [DEBUG   ] summary = ERROR
2019-01-18 11:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206236  13 58501 39965941 A  ERRORERROR'
2019-01-18 11:06:05 [DEBUG   ] Got command RPT from MCS: ref #1206237
2019-01-18 11:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206237  77 58501 39965942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:06:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:06:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:06:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:06:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:06:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:06:22 [DEBUG   ] Finished updating board flags in 1.462 seconds
2019-01-18 11:06:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 11:06:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:07:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 11:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:07:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:07:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:07:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:07:22 [WARNING ] (13, 1, 'bot')
2019-01-18 11:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:07:22 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-18 11:07:29 [DEBUG   ] Got command RPT from MCS: ref #1206259
2019-01-18 11:07:29 [DEBUG   ] summary = ERROR
2019-01-18 11:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206259  13 58501 40049521 A  ERRORERROR'
2019-01-18 11:07:29 [DEBUG   ] Got command RPT from MCS: ref #1206260
2019-01-18 11:07:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206260  77 58501 40049725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:07:29 [DEBUG   ] Got command RPT from MCS: ref #1206261
2019-01-18 11:07:29 [DEBUG   ] summary = ERROR
2019-01-18 11:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206261  13 58501 40049917 A  ERRORERROR'
2019-01-18 11:07:30 [DEBUG   ] Got command RPT from MCS: ref #1206263
2019-01-18 11:07:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206263  77 58501 40050121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:07:30 [DEBUG   ] Got command RPT from MCS: ref #1206264
2019-01-18 11:07:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206264  12 58501 40050326 A  ERRORB™™š'
2019-01-18 11:07:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:07:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:08:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 11:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:08:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:08:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:08:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:08:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:08:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:08:23 [DEBUG   ] Finished updating board flags in 2.259 seconds
2019-01-18 11:08:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 11:08:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:09:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 11:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:09:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:09:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:09:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:09:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:09:23 [DEBUG   ] Finished updating board flags in 2.090 seconds
2019-01-18 11:09:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:09:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 11:10:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 11:10:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 11:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:10:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:10:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:10:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:10:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:10:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:10:23 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-18 11:10:32 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-18 11:10:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 11:11:05 [DEBUG   ] Got command RPT from MCS: ref #1206273
2019-01-18 11:11:05 [DEBUG   ] summary = ERROR
2019-01-18 11:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206273  13 58501 40265945 A  ERRORERROR'
2019-01-18 11:11:05 [DEBUG   ] Got command RPT from MCS: ref #1206274
2019-01-18 11:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206274  77 58501 40265946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:11:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:11:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:11:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:11:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:11:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:11:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:11:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:11:23 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-01-18 11:11:32 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-18 11:11:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:12:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:12:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:12:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:12:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:12:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:12:23 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-18 11:12:29 [DEBUG   ] Got command RPT from MCS: ref #1206290
2019-01-18 11:12:29 [DEBUG   ] summary = ERROR
2019-01-18 11:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206290  13 58501 40349597 A  ERRORERROR'
2019-01-18 11:12:29 [DEBUG   ] Got command RPT from MCS: ref #1206291
2019-01-18 11:12:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206291  77 58501 40349801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:12:30 [DEBUG   ] Got command RPT from MCS: ref #1206292
2019-01-18 11:12:30 [DEBUG   ] summary = ERROR
2019-01-18 11:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206292  13 58501 40350005 A  ERRORERROR'
2019-01-18 11:12:30 [DEBUG   ] Got command RPT from MCS: ref #1206293
2019-01-18 11:12:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206293  77 58501 40350209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:12:30 [DEBUG   ] Got command RPT from MCS: ref #1206294
2019-01-18 11:12:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206294  12 58501 40350401 A  ERRORB˜™š'
2019-01-18 11:12:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:12:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:13:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:13:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:13:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:13:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:13:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:13:23 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-18 11:13:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 11:13:52 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-18 11:14:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:14:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 11:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:14:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:14:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:14:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:14:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:14:23 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-18 11:14:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:14:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:15:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:15:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:15:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:15:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:15:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:15:23 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-18 11:15:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:15:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:16:05 [DEBUG   ] Got command RPT from MCS: ref #1206303
2019-01-18 11:16:05 [DEBUG   ] summary = ERROR
2019-01-18 11:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206303  13 58501 40565949 A  ERRORERROR'
2019-01-18 11:16:05 [DEBUG   ] Got command RPT from MCS: ref #1206304
2019-01-18 11:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206304  77 58501 40565950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:16:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:16:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:16:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:16:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:16:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:16:23 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-18 11:16:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:16:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:17:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:17:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 11:17:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:17:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:17:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:17:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:17:23 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-18 11:17:29 [DEBUG   ] Got command RPT from MCS: ref #1206322
2019-01-18 11:17:29 [DEBUG   ] summary = ERROR
2019-01-18 11:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206322  13 58501 40649685 A  ERRORERROR'
2019-01-18 11:17:29 [DEBUG   ] Got command RPT from MCS: ref #1206323
2019-01-18 11:17:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206323  77 58501 40649877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:17:30 [DEBUG   ] Got command RPT from MCS: ref #1206324
2019-01-18 11:17:30 [DEBUG   ] summary = ERROR
2019-01-18 11:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206324  13 58501 40650081 A  ERRORERROR'
2019-01-18 11:17:30 [DEBUG   ] Got command RPT from MCS: ref #1206326
2019-01-18 11:17:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206326  77 58501 40650285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:17:30 [DEBUG   ] Got command RPT from MCS: ref #1206328
2019-01-18 11:17:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206328  12 58501 40650489 A  ERRORB™™š'
2019-01-18 11:17:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:17:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:18:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:18:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:18:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:18:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:18:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:18:23 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-18 11:18:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 11:18:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:19:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:19:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:19:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:19:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:19:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:19:23 [DEBUG   ] Finished updating board flags in 1.668 seconds
2019-01-18 11:19:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 11:19:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 11:20:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:20:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 11:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:20:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:20:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:20:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:20:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:20:23 [DEBUG   ] Finished updating board flags in 1.508 seconds
2019-01-18 11:20:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 11:20:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 11:21:05 [DEBUG   ] Got command RPT from MCS: ref #1206336
2019-01-18 11:21:05 [DEBUG   ] summary = ERROR
2019-01-18 11:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206336  13 58501 40865949 A  ERRORERROR'
2019-01-18 11:21:05 [DEBUG   ] Got command RPT from MCS: ref #1206337
2019-01-18 11:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206337  77 58501 40865950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:21:12 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 11:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:21:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:21:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:21:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:21:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:21:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:21:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:21:23 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-01-18 11:21:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 11:21:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 11:22:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:22:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:22:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:22:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:22:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:22:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:22:23 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-01-18 11:22:29 [DEBUG   ] Got command RPT from MCS: ref #1206357
2019-01-18 11:22:29 [DEBUG   ] summary = ERROR
2019-01-18 11:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206357  13 58501 40949765 A  ERRORERROR'
2019-01-18 11:22:29 [DEBUG   ] Got command RPT from MCS: ref #1206358
2019-01-18 11:22:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206358  77 58501 40949969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:22:30 [DEBUG   ] Got command RPT from MCS: ref #1206359
2019-01-18 11:22:30 [DEBUG   ] summary = ERROR
2019-01-18 11:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206359  13 58501 40950161 A  ERRORERROR'
2019-01-18 11:22:30 [DEBUG   ] Got command RPT from MCS: ref #1206360
2019-01-18 11:22:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206360  77 58501 40950365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:22:30 [DEBUG   ] Got command RPT from MCS: ref #1206361
2019-01-18 11:22:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206361  12 58501 40950569 A  ERRORB˜™š'
2019-01-18 11:22:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 11:22:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:23:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:23:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:23:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:23:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:23:23 [WARNING ] (13, 1, 'bot')
2019-01-18 11:23:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:23:23 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-18 11:23:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:23:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:24:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:24:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:24:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:24:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:24:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:24:24 [DEBUG   ] Finished updating board flags in 2.145 seconds
2019-01-18 11:24:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:24:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:25:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:25:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 11:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:25:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:25:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:25:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:25:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:25:24 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-18 11:25:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:25:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:26:05 [DEBUG   ] Got command RPT from MCS: ref #1206366
2019-01-18 11:26:05 [DEBUG   ] summary = ERROR
2019-01-18 11:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206366  13 58501 41165949 A  ERRORERROR'
2019-01-18 11:26:05 [DEBUG   ] Got command RPT from MCS: ref #1206367
2019-01-18 11:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206367  77 58501 41165950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:26:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:26:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:26:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:26:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:26:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:26:24 [DEBUG   ] Finished updating board flags in 2.100 seconds
2019-01-18 11:26:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:26:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:27:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:27:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:27:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:27:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:27:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:27:24 [DEBUG   ] Finished updating board flags in 1.868 seconds
2019-01-18 11:27:29 [DEBUG   ] Got command RPT from MCS: ref #1206385
2019-01-18 11:27:29 [DEBUG   ] summary = ERROR
2019-01-18 11:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206385  13 58501 41249849 A  ERRORERROR'
2019-01-18 11:27:30 [DEBUG   ] Got command RPT from MCS: ref #1206386
2019-01-18 11:27:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206386  77 58501 41250041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:27:30 [DEBUG   ] Got command RPT from MCS: ref #1206387
2019-01-18 11:27:30 [DEBUG   ] summary = ERROR
2019-01-18 11:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206387  13 58501 41250245 A  ERRORERROR'
2019-01-18 11:27:30 [DEBUG   ] Got command RPT from MCS: ref #1206389
2019-01-18 11:27:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206389  77 58501 41250449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:27:30 [DEBUG   ] Got command RPT from MCS: ref #1206391
2019-01-18 11:27:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206391  12 58501 41250641 A  ERRORB™™š'
2019-01-18 11:27:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:27:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:28:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:28:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:28:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 11:28:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:28:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:28:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:28:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:28:24 [DEBUG   ] Finished updating board flags in 1.835 seconds
2019-01-18 11:28:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:28:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:29:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:29:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:29:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:29:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:29:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:29:24 [DEBUG   ] Finished updating board flags in 1.766 seconds
2019-01-18 11:29:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:29:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:30:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 11:30:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:30:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:30:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:30:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:30:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:30:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:30:24 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-01-18 11:30:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 11:30:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:31:05 [DEBUG   ] Got command RPT from MCS: ref #1206403
2019-01-18 11:31:05 [DEBUG   ] summary = ERROR
2019-01-18 11:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206403  13 58501 41465949 A  ERRORERROR'
2019-01-18 11:31:05 [DEBUG   ] Got command RPT from MCS: ref #1206404
2019-01-18 11:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206404  77 58501 41465950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:31:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:31:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:31:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:31:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:31:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:31:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:31:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:31:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:31:24 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-18 11:31:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:31:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:32:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:32:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:32:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:32:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:32:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:32:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:32:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:32:24 [DEBUG   ] Finished updating board flags in 1.558 seconds
2019-01-18 11:32:29 [DEBUG   ] Got command RPT from MCS: ref #1206420
2019-01-18 11:32:29 [DEBUG   ] summary = ERROR
2019-01-18 11:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206420  13 58501 41549921 A  ERRORERROR'
2019-01-18 11:32:30 [DEBUG   ] Got command RPT from MCS: ref #1206421
2019-01-18 11:32:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206421  77 58501 41550125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:32:30 [DEBUG   ] Got command RPT from MCS: ref #1206422
2019-01-18 11:32:30 [DEBUG   ] summary = ERROR
2019-01-18 11:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206422  13 58501 41550329 A  ERRORERROR'
2019-01-18 11:32:30 [DEBUG   ] Got command RPT from MCS: ref #1206423
2019-01-18 11:32:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206423  77 58501 41550533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:32:30 [DEBUG   ] Got command RPT from MCS: ref #1206424
2019-01-18 11:32:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206424  12 58501 41550725 A  ERRORB™™š'
2019-01-18 11:32:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:32:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:33:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 11:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:33:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:33:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:33:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:33:24 [WARNING ] (13, 1, 'bot')
2019-01-18 11:33:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:33:24 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-18 11:33:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:33:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:34:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 11:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:34:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:34:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:34:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:34:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:34:25 [DEBUG   ] Finished updating board flags in 2.200 seconds
2019-01-18 11:34:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 11:34:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:35:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:35:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:35:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:35:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:35:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:35:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:35:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:35:25 [DEBUG   ] Finished updating board flags in 2.070 seconds
2019-01-18 11:35:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:35:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:36:05 [DEBUG   ] Got command RPT from MCS: ref #1206429
2019-01-18 11:36:05 [DEBUG   ] summary = ERROR
2019-01-18 11:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206429  13 58501 41765953 A  ERRORERROR'
2019-01-18 11:36:05 [DEBUG   ] Got command RPT from MCS: ref #1206430
2019-01-18 11:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206430  77 58501 41765954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:36:13 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-18 11:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:36:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:36:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:36:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:36:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:36:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:36:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:36:25 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-18 11:36:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 11:36:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 11:37:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 11:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:37:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:37:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:37:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:37:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:37:25 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-18 11:37:30 [DEBUG   ] Got command RPT from MCS: ref #1206452
2019-01-18 11:37:30 [DEBUG   ] summary = ERROR
2019-01-18 11:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206452  13 58501 41850005 A  ERRORERROR'
2019-01-18 11:37:30 [DEBUG   ] Got command RPT from MCS: ref #1206453
2019-01-18 11:37:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206453  77 58501 41850209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:37:30 [DEBUG   ] Got command RPT from MCS: ref #1206454
2019-01-18 11:37:30 [DEBUG   ] summary = ERROR
2019-01-18 11:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206454  13 58501 41850413 A  ERRORERROR'
2019-01-18 11:37:30 [DEBUG   ] Got command RPT from MCS: ref #1206456
2019-01-18 11:37:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206456  77 58501 41850605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:37:30 [DEBUG   ] Got command RPT from MCS: ref #1206457
2019-01-18 11:37:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206457  12 58501 41850809 A  ERRORB˜™š'
2019-01-18 11:37:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 11:37:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 11:38:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 11:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:38:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 11:38:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:38:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:38:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:38:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:38:25 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-18 11:38:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:38:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:39:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:39:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:39:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:39:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:39:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:39:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:39:25 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-18 11:39:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:39:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:40:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:40:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:40:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:40:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:40:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:40:25 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-18 11:40:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:40:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:41:05 [DEBUG   ] Got command RPT from MCS: ref #1206466
2019-01-18 11:41:05 [DEBUG   ] summary = ERROR
2019-01-18 11:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206466  13 58501 42065949 A  ERRORERROR'
2019-01-18 11:41:05 [DEBUG   ] Got command RPT from MCS: ref #1206467
2019-01-18 11:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206467  77 58501 42065950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:41:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 11:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:41:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:41:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:41:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:41:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:41:25 [DEBUG   ] Finished updating board flags in 1.674 seconds
2019-01-18 11:41:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:41:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 11:42:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 11:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:42:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:42:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:42:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:42:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:42:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:42:25 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-18 11:42:30 [DEBUG   ] Got command RPT from MCS: ref #1206483
2019-01-18 11:42:30 [DEBUG   ] summary = ERROR
2019-01-18 11:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206483  13 58501 42150085 A  ERRORERROR'
2019-01-18 11:42:30 [DEBUG   ] Got command RPT from MCS: ref #1206484
2019-01-18 11:42:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206484  77 58501 42150289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:42:30 [DEBUG   ] Got command RPT from MCS: ref #1206485
2019-01-18 11:42:30 [DEBUG   ] summary = ERROR
2019-01-18 11:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206485  13 58501 42150481 A  ERRORERROR'
2019-01-18 11:42:30 [DEBUG   ] Got command RPT from MCS: ref #1206486
2019-01-18 11:42:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206486  77 58501 42150685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:42:30 [DEBUG   ] Got command RPT from MCS: ref #1206487
2019-01-18 11:42:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206487  12 58501 42150889 A  ERRORB™™š'
2019-01-18 11:42:34 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-18 11:42:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:43:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 11:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:43:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:43:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:43:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:43:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:43:25 [DEBUG   ] Finished updating board flags in 1.512 seconds
2019-01-18 11:43:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 11:43:54 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-18 11:44:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:44:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:44:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:44:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:44:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:44:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:44:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:44:25 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-01-18 11:44:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:44:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:45:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:45:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:45:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:45:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:45:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:45:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:45:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:45:25 [DEBUG   ] Finished updating board flags in 1.514 seconds
2019-01-18 11:45:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:45:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:46:05 [DEBUG   ] Got command RPT from MCS: ref #1206496
2019-01-18 11:46:05 [DEBUG   ] summary = ERROR
2019-01-18 11:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206496  13 58501 42365949 A  ERRORERROR'
2019-01-18 11:46:05 [DEBUG   ] Got command RPT from MCS: ref #1206497
2019-01-18 11:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206497  77 58501 42365950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:46:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 11:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:46:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 11:46:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:46:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:46:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:46:25 [WARNING ] (13, 1, 'bot')
2019-01-18 11:46:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:46:25 [DEBUG   ] Finished updating board flags in 1.532 seconds
2019-01-18 11:46:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:46:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:47:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:47:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:47:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:47:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:47:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:47:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:47:26 [DEBUG   ] Finished updating board flags in 2.166 seconds
2019-01-18 11:47:30 [DEBUG   ] Got command RPT from MCS: ref #1206515
2019-01-18 11:47:30 [DEBUG   ] summary = ERROR
2019-01-18 11:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206515  13 58501 42450165 A  ERRORERROR'
2019-01-18 11:47:30 [DEBUG   ] Got command RPT from MCS: ref #1206516
2019-01-18 11:47:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206516  77 58501 42450369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:47:30 [DEBUG   ] Got command RPT from MCS: ref #1206517
2019-01-18 11:47:30 [DEBUG   ] summary = ERROR
2019-01-18 11:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206517  13 58501 42450561 A  ERRORERROR'
2019-01-18 11:47:30 [DEBUG   ] Got command RPT from MCS: ref #1206519
2019-01-18 11:47:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206519  77 58501 42450765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:47:30 [DEBUG   ] Got command RPT from MCS: ref #1206520
2019-01-18 11:47:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206520  12 58501 42450969 A  ERRORB˜™š'
2019-01-18 11:47:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:47:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:48:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:48:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:48:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:48:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:48:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:48:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:48:26 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-18 11:48:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:48:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:49:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:49:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 11:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:49:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:49:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:49:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:49:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:49:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:49:26 [DEBUG   ] Finished updating board flags in 1.868 seconds
2019-01-18 11:49:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:49:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:50:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:50:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-18 11:50:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:50:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:50:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:50:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:50:26 [DEBUG   ] Finished updating board flags in 1.707 seconds
2019-01-18 11:50:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:50:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:51:05 [DEBUG   ] Got command RPT from MCS: ref #1206529
2019-01-18 11:51:05 [DEBUG   ] summary = ERROR
2019-01-18 11:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206529  13 58501 42665949 A  ERRORERROR'
2019-01-18 11:51:05 [DEBUG   ] Got command RPT from MCS: ref #1206530
2019-01-18 11:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206530  77 58501 42665950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:51:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:51:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:51:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:51:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:51:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:51:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:51:26 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-18 11:51:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 11:51:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:52:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:52:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:52:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:52:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:52:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:52:26 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-18 11:52:30 [DEBUG   ] Got command RPT from MCS: ref #1206550
2019-01-18 11:52:30 [DEBUG   ] summary = ERROR
2019-01-18 11:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206550  13 58501 42750241 A  ERRORERROR'
2019-01-18 11:52:30 [DEBUG   ] Got command RPT from MCS: ref #1206551
2019-01-18 11:52:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206551  77 58501 42750445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:52:30 [DEBUG   ] Got command RPT from MCS: ref #1206552
2019-01-18 11:52:30 [DEBUG   ] summary = ERROR
2019-01-18 11:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206552  13 58501 42750649 A  ERRORERROR'
2019-01-18 11:52:30 [DEBUG   ] Got command RPT from MCS: ref #1206553
2019-01-18 11:52:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206553  77 58501 42750841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:52:31 [DEBUG   ] Got command RPT from MCS: ref #1206554
2019-01-18 11:52:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206554  12 58501 42751045 A  ERRORB™™š'
2019-01-18 11:52:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:52:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:53:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:53:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 11:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:53:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:53:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:53:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:53:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:53:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:53:26 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-18 11:53:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:53:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:54:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:54:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:54:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:54:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:54:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:54:26 [DEBUG   ] Finished updating board flags in 1.665 seconds
2019-01-18 11:54:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:54:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:55:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:55:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:55:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:55:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:55:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:55:26 [DEBUG   ] Finished updating board flags in 1.485 seconds
2019-01-18 11:55:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 11:55:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:56:05 [DEBUG   ] Got command RPT from MCS: ref #1206559
2019-01-18 11:56:05 [DEBUG   ] summary = ERROR
2019-01-18 11:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206559  13 58501 42965957 A  ERRORERROR'
2019-01-18 11:56:05 [DEBUG   ] Got command RPT from MCS: ref #1206560
2019-01-18 11:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206560  77 58501 42965958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:56:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:56:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:56:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:56:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:56:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:56:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:56:26 [DEBUG   ] Finished updating board flags in 1.504 seconds
2019-01-18 11:56:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:56:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:57:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:57:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:57:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:57:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:57:26 [WARNING ] (13, 1, 'bot')
2019-01-18 11:57:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:57:26 [DEBUG   ] Finished updating board flags in 1.522 seconds
2019-01-18 11:57:30 [DEBUG   ] Got command RPT from MCS: ref #1206578
2019-01-18 11:57:30 [DEBUG   ] summary = ERROR
2019-01-18 11:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206578  13 58501 43050325 A  ERRORERROR'
2019-01-18 11:57:30 [DEBUG   ] Got command RPT from MCS: ref #1206579
2019-01-18 11:57:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206579  77 58501 43050529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:57:30 [DEBUG   ] Got command RPT from MCS: ref #1206580
2019-01-18 11:57:30 [DEBUG   ] summary = ERROR
2019-01-18 11:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206580  13 58501 43050721 A  ERRORERROR'
2019-01-18 11:57:30 [DEBUG   ] Got command RPT from MCS: ref #1206582
2019-01-18 11:57:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 11:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206582  77 58501 43050925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 11:57:31 [DEBUG   ] Got command RPT from MCS: ref #1206583
2019-01-18 11:57:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 11:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206583  12 58501 43051129 A  ERRORB™™š'
2019-01-18 11:57:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:57:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 11:58:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:58:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 11:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:58:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:58:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:58:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:58:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:58:27 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-01-18 11:58:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:58:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 11:59:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 11:59:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 11:59:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:59:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:59:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:59:27 [WARNING ] (13, 1, 'bot')
2019-01-18 11:59:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 11:59:27 [DEBUG   ] Finished updating board flags in 2.297 seconds
2019-01-18 11:59:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 11:59:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:00:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:00:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:00:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:00:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:00:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:00:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:00:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:00:27 [DEBUG   ] Finished updating board flags in 2.086 seconds
2019-01-18 12:00:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:00:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 12:01:05 [DEBUG   ] Got command RPT from MCS: ref #1206596
2019-01-18 12:01:05 [DEBUG   ] summary = ERROR
2019-01-18 12:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206596  13 58501 43265953 A  ERRORERROR'
2019-01-18 12:01:05 [DEBUG   ] Got command RPT from MCS: ref #1206597
2019-01-18 12:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206597  77 58501 43265954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:01:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:01:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:01:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:01:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:01:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:01:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:01:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:01:27 [DEBUG   ] Finished updating board flags in 1.995 seconds
2019-01-18 12:01:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:01:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:02:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:02:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:02:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:02:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:02:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:02:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:02:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:02:27 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-18 12:02:30 [DEBUG   ] Got command RPT from MCS: ref #1206613
2019-01-18 12:02:30 [DEBUG   ] summary = ERROR
2019-01-18 12:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206613  13 58501 43350409 A  ERRORERROR'
2019-01-18 12:02:30 [DEBUG   ] Got command RPT from MCS: ref #1206614
2019-01-18 12:02:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206614  77 58501 43350602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:02:30 [DEBUG   ] Got command RPT from MCS: ref #1206615
2019-01-18 12:02:30 [DEBUG   ] summary = ERROR
2019-01-18 12:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206615  13 58501 43350806 A  ERRORERROR'
2019-01-18 12:02:31 [DEBUG   ] Got command RPT from MCS: ref #1206616
2019-01-18 12:02:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206616  77 58501 43351009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:02:31 [DEBUG   ] Got command RPT from MCS: ref #1206617
2019-01-18 12:02:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206617  12 58501 43351213 A  ERRORB™™š'
2019-01-18 12:02:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:02:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:03:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:03:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:03:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:03:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:03:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:03:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:03:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:03:27 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-18 12:03:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 12:03:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:04:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:04:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:04:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:04:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:04:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:04:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:04:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:04:27 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-18 12:04:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:04:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:05:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:05:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:05:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 12:05:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:05:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:05:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:05:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:05:27 [DEBUG   ] Finished updating board flags in 1.719 seconds
2019-01-18 12:05:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:05:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:06:05 [DEBUG   ] Got command RPT from MCS: ref #1206622
2019-01-18 12:06:05 [DEBUG   ] summary = ERROR
2019-01-18 12:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206622  13 58501 43565949 A  ERRORERROR'
2019-01-18 12:06:05 [DEBUG   ] Got command RPT from MCS: ref #1206623
2019-01-18 12:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206623  77 58501 43565950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:06:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:06:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:06:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:06:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:06:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:06:27 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-01-18 12:06:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:06:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:07:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:07:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:07:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:07:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:07:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:07:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:07:27 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-18 12:07:30 [DEBUG   ] Got command RPT from MCS: ref #1206645
2019-01-18 12:07:30 [DEBUG   ] summary = ERROR
2019-01-18 12:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206645  13 58501 43650485 A  ERRORERROR'
2019-01-18 12:07:30 [DEBUG   ] Got command RPT from MCS: ref #1206646
2019-01-18 12:07:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206646  77 58501 43650689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:07:30 [DEBUG   ] Got command RPT from MCS: ref #1206647
2019-01-18 12:07:30 [DEBUG   ] summary = ERROR
2019-01-18 12:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206647  13 58501 43650893 A  ERRORERROR'
2019-01-18 12:07:31 [DEBUG   ] Got command RPT from MCS: ref #1206649
2019-01-18 12:07:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206649  77 58501 43651085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:07:31 [DEBUG   ] Got command RPT from MCS: ref #1206650
2019-01-18 12:07:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206650  12 58501 43651289 A  ERRORB™™š'
2019-01-18 12:07:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:07:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:08:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:08:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:08:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:08:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:08:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:08:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:08:27 [DEBUG   ] Finished updating board flags in 1.493 seconds
2019-01-18 12:08:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:08:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 12:09:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:09:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:09:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:09:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:09:27 [WARNING ] (13, 1, 'bot')
2019-01-18 12:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:09:27 [DEBUG   ] Finished updating board flags in 1.505 seconds
2019-01-18 12:09:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:09:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:10:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 12:10:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:10:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:10:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:10:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:10:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:10:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:10:28 [DEBUG   ] Finished updating board flags in 2.277 seconds
2019-01-18 12:10:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:10:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:11:05 [DEBUG   ] Got command RPT from MCS: ref #1206659
2019-01-18 12:11:05 [DEBUG   ] summary = ERROR
2019-01-18 12:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206659  13 58501 43865957 A  ERRORERROR'
2019-01-18 12:11:05 [DEBUG   ] Got command RPT from MCS: ref #1206660
2019-01-18 12:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206660  77 58501 43865958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:11:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:11:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:11:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:11:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:11:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:11:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:11:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:11:28 [DEBUG   ] Finished updating board flags in 2.140 seconds
2019-01-18 12:11:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:11:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:12:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:12:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:12:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 12:12:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:12:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:12:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:12:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:12:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:12:28 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-18 12:12:30 [DEBUG   ] Got command RPT from MCS: ref #1206676
2019-01-18 12:12:30 [DEBUG   ] summary = ERROR
2019-01-18 12:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206676  13 58501 43950565 A  ERRORERROR'
2019-01-18 12:12:30 [DEBUG   ] Got command RPT from MCS: ref #1206677
2019-01-18 12:12:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206677  77 58501 43950769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:12:30 [DEBUG   ] Got command RPT from MCS: ref #1206678
2019-01-18 12:12:30 [DEBUG   ] summary = ERROR
2019-01-18 12:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206678  13 58501 43950973 A  ERRORERROR'
2019-01-18 12:12:31 [DEBUG   ] Got command RPT from MCS: ref #1206679
2019-01-18 12:12:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206679  77 58501 43951165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:12:31 [DEBUG   ] Got command RPT from MCS: ref #1206680
2019-01-18 12:12:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206680  12 58501 43951369 A  ERRORB˜™š'
2019-01-18 12:12:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 12:12:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 12:13:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-18 12:13:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:13:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:13:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:13:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:13:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:13:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:13:28 [DEBUG   ] Finished updating board flags in 1.942 seconds
2019-01-18 12:13:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 12:13:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 12:14:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 12:14:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 12:14:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:14:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:14:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:14:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:14:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:14:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:14:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:14:28 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-18 12:14:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:14:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 12:15:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:15:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:15:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:15:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:15:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:15:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:15:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:15:28 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-18 12:15:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:15:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:16:05 [DEBUG   ] Got command RPT from MCS: ref #1206689
2019-01-18 12:16:05 [DEBUG   ] summary = ERROR
2019-01-18 12:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206689  13 58501 44165961 A  ERRORERROR'
2019-01-18 12:16:05 [DEBUG   ] Got command RPT from MCS: ref #1206690
2019-01-18 12:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206690  77 58501 44165962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:16:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 12:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:16:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:16:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:16:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:16:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:16:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:16:28 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-18 12:16:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:16:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:17:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:17:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:17:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:17:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:17:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:17:28 [DEBUG   ] Finished updating board flags in 1.831 seconds
2019-01-18 12:17:30 [DEBUG   ] Got command RPT from MCS: ref #1206708
2019-01-18 12:17:30 [DEBUG   ] summary = ERROR
2019-01-18 12:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206708  13 58501 44250645 A  ERRORERROR'
2019-01-18 12:17:30 [DEBUG   ] Got command RPT from MCS: ref #1206709
2019-01-18 12:17:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206709  77 58501 44250849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:17:31 [DEBUG   ] Got command RPT from MCS: ref #1206710
2019-01-18 12:17:31 [DEBUG   ] summary = ERROR
2019-01-18 12:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206710  13 58501 44251053 A  ERRORERROR'
2019-01-18 12:17:31 [DEBUG   ] Got command RPT from MCS: ref #1206712
2019-01-18 12:17:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206712  77 58501 44251245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:17:31 [DEBUG   ] Got command RPT from MCS: ref #1206714
2019-01-18 12:17:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206714  12 58501 44251449 A  ERRORB™™š'
2019-01-18 12:17:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 12:17:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 12:18:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:18:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:18:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:18:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:18:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:18:28 [DEBUG   ] Finished updating board flags in 1.756 seconds
2019-01-18 12:18:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 12:18:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 12:19:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:19:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:19:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:19:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:19:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:19:28 [DEBUG   ] Finished updating board flags in 1.682 seconds
2019-01-18 12:19:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:19:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:20:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 12:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:20:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 12:20:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:20:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:20:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:20:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:20:28 [DEBUG   ] Finished updating board flags in 1.548 seconds
2019-01-18 12:20:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:20:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:21:05 [DEBUG   ] Got command RPT from MCS: ref #1206722
2019-01-18 12:21:05 [DEBUG   ] summary = ERROR
2019-01-18 12:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206722  13 58501 44465953 A  ERRORERROR'
2019-01-18 12:21:05 [DEBUG   ] Got command RPT from MCS: ref #1206723
2019-01-18 12:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206723  77 58501 44465954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:21:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 12:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:21:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:21:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:21:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:21:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:21:28 [DEBUG   ] Finished updating board flags in 1.479 seconds
2019-01-18 12:21:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 12:21:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:22:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:22:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:22:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:22:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:22:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:22:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:22:28 [WARNING ] (13, 1, 'bot')
2019-01-18 12:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:22:28 [DEBUG   ] Finished updating board flags in 1.518 seconds
2019-01-18 12:22:30 [DEBUG   ] Got command RPT from MCS: ref #1206743
2019-01-18 12:22:30 [DEBUG   ] summary = ERROR
2019-01-18 12:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206743  13 58501 44550721 A  ERRORERROR'
2019-01-18 12:22:30 [DEBUG   ] Got command RPT from MCS: ref #1206744
2019-01-18 12:22:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206744  77 58501 44550925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:22:31 [DEBUG   ] Got command RPT from MCS: ref #1206745
2019-01-18 12:22:31 [DEBUG   ] summary = ERROR
2019-01-18 12:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206745  13 58501 44551129 A  ERRORERROR'
2019-01-18 12:22:31 [DEBUG   ] Got command RPT from MCS: ref #1206746
2019-01-18 12:22:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206746  77 58501 44551333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:22:31 [DEBUG   ] Got command RPT from MCS: ref #1206747
2019-01-18 12:22:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206747  12 58501 44551525 A  ERRORB™™š'
2019-01-18 12:22:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:22:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 12:23:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 12:23:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:23:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:23:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:23:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:23:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:23:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:23:29 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-01-18 12:23:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:23:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:24:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:24:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:24:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:24:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:24:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:24:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:24:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:24:29 [DEBUG   ] Finished updating board flags in 2.128 seconds
2019-01-18 12:24:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:24:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 12:25:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 12:25:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:25:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:25:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:25:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:25:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:25:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:25:29 [DEBUG   ] Finished updating board flags in 2.035 seconds
2019-01-18 12:25:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 12:25:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 12:26:05 [DEBUG   ] Got command RPT from MCS: ref #1206752
2019-01-18 12:26:05 [DEBUG   ] summary = ERROR
2019-01-18 12:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206752  13 58501 44765953 A  ERRORERROR'
2019-01-18 12:26:05 [DEBUG   ] Got command RPT from MCS: ref #1206753
2019-01-18 12:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206753  77 58501 44765954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:26:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-18 12:26:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:26:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 12:26:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:26:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:26:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:26:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:26:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:26:29 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-18 12:26:36 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-18 12:26:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:27:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:27:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:27:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 12:27:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:27:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:27:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:27:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:27:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:27:29 [DEBUG   ] Finished updating board flags in 1.956 seconds
2019-01-18 12:27:30 [DEBUG   ] Got command RPT from MCS: ref #1206771
2019-01-18 12:27:30 [DEBUG   ] summary = ERROR
2019-01-18 12:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206771  13 58501 44850805 A  ERRORERROR'
2019-01-18 12:27:31 [DEBUG   ] Got command RPT from MCS: ref #1206772
2019-01-18 12:27:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206772  77 58501 44851009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:27:31 [DEBUG   ] Got command RPT from MCS: ref #1206773
2019-01-18 12:27:31 [DEBUG   ] summary = ERROR
2019-01-18 12:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206773  13 58501 44851201 A  ERRORERROR'
2019-01-18 12:27:31 [DEBUG   ] Got command RPT from MCS: ref #1206775
2019-01-18 12:27:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206775  77 58501 44851405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:27:31 [DEBUG   ] Got command RPT from MCS: ref #1206776
2019-01-18 12:27:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206776  12 58501 44851609 A  ERRORB™™š'
2019-01-18 12:27:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:27:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:28:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:28:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:28:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:28:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:28:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:28:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:28:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:28:29 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-18 12:28:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:28:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:29:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:29:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:29:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:29:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:29:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:29:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:29:29 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-18 12:29:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:29:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:30:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:30:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 12:30:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:30:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:30:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:30:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:30:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:30:29 [DEBUG   ] Finished updating board flags in 1.765 seconds
2019-01-18 12:30:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 12:30:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:31:05 [DEBUG   ] Got command RPT from MCS: ref #1206789
2019-01-18 12:31:05 [DEBUG   ] summary = ERROR
2019-01-18 12:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206789  13 58501 45065965 A  ERRORERROR'
2019-01-18 12:31:05 [DEBUG   ] Got command RPT from MCS: ref #1206790
2019-01-18 12:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206790  77 58501 45065966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:31:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:31:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:31:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:31:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:31:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:31:29 [DEBUG   ] Finished updating board flags in 1.703 seconds
2019-01-18 12:31:36 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-18 12:31:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 12:32:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:32:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:32:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:32:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:32:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:32:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:32:29 [DEBUG   ] Finished updating board flags in 1.507 seconds
2019-01-18 12:32:30 [DEBUG   ] Got command RPT from MCS: ref #1206806
2019-01-18 12:32:30 [DEBUG   ] summary = ERROR
2019-01-18 12:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206806  13 58501 45150885 A  ERRORERROR'
2019-01-18 12:32:31 [DEBUG   ] Got command RPT from MCS: ref #1206807
2019-01-18 12:32:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206807  77 58501 45151089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:32:31 [DEBUG   ] Got command RPT from MCS: ref #1206808
2019-01-18 12:32:31 [DEBUG   ] summary = ERROR
2019-01-18 12:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206808  13 58501 45151281 A  ERRORERROR'
2019-01-18 12:32:31 [DEBUG   ] Got command RPT from MCS: ref #1206809
2019-01-18 12:32:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206809  77 58501 45151485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:32:31 [DEBUG   ] Got command RPT from MCS: ref #1206810
2019-01-18 12:32:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206810  12 58501 45151689 A  ERRORB™™š'
2019-01-18 12:32:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:32:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:33:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 12:33:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:33:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:33:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:33:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:33:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:33:29 [DEBUG   ] Finished updating board flags in 1.507 seconds
2019-01-18 12:33:36 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 12:33:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:34:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:34:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:34:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:34:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:34:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:34:29 [WARNING ] (13, 1, 'bot')
2019-01-18 12:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:34:29 [DEBUG   ] Finished updating board flags in 1.511 seconds
2019-01-18 12:34:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:34:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:35:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:35:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:35:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:35:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:35:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:35:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:35:30 [DEBUG   ] Finished updating board flags in 2.228 seconds
2019-01-18 12:35:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:35:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:36:05 [DEBUG   ] Got command RPT from MCS: ref #1206815
2019-01-18 12:36:05 [DEBUG   ] summary = ERROR
2019-01-18 12:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206815  13 58501 45365961 A  ERRORERROR'
2019-01-18 12:36:05 [DEBUG   ] Got command RPT from MCS: ref #1206816
2019-01-18 12:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206816  77 58501 45365962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:36:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:36:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:36:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:36:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:36:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:36:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:36:30 [DEBUG   ] Finished updating board flags in 2.172 seconds
2019-01-18 12:36:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:36:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:37:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 12:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:37:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:37:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:37:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:37:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:37:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:37:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:37:30 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-18 12:37:30 [DEBUG   ] Got command RPT from MCS: ref #1206838
2019-01-18 12:37:30 [DEBUG   ] summary = ERROR
2019-01-18 12:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206838  13 58501 45450969 A  ERRORERROR'
2019-01-18 12:37:31 [DEBUG   ] Got command RPT from MCS: ref #1206839
2019-01-18 12:37:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206839  77 58501 45451161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:37:31 [DEBUG   ] Got command RPT from MCS: ref #1206840
2019-01-18 12:37:31 [DEBUG   ] summary = ERROR
2019-01-18 12:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206840  13 58501 45451365 A  ERRORERROR'
2019-01-18 12:37:31 [DEBUG   ] Got command RPT from MCS: ref #1206841
2019-01-18 12:37:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206841  77 58501 45451569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:37:31 [DEBUG   ] Got command RPT from MCS: ref #1206843
2019-01-18 12:37:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206843  12 58501 45451761 A  ERRORB™™š'
2019-01-18 12:37:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:37:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:38:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:38:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:38:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 12:38:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:38:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:38:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:38:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:38:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:38:30 [DEBUG   ] Finished updating board flags in 2.066 seconds
2019-01-18 12:38:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-18 12:38:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-18 12:39:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:39:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:39:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:39:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 12:39:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:39:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:39:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:39:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:39:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:39:30 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-18 12:39:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 12:39:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 12:40:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 12:40:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:40:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:40:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 12:40:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:40:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:40:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:40:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:40:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:40:30 [DEBUG   ] Finished updating board flags in 1.901 seconds
2019-01-18 12:40:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:40:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #1206852
2019-01-18 12:41:05 [DEBUG   ] summary = ERROR
2019-01-18 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206852  13 58501 45665957 A  ERRORERROR'
2019-01-18 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #1206853
2019-01-18 12:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206853  77 58501 45665958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:41:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 12:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:41:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:41:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:41:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:41:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:41:30 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-18 12:41:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 12:41:57 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-18 12:42:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 12:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:42:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:42:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:42:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:42:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:42:30 [DEBUG   ] Finished updating board flags in 1.770 seconds
2019-01-18 12:42:31 [DEBUG   ] Got command RPT from MCS: ref #1206869
2019-01-18 12:42:31 [DEBUG   ] summary = ERROR
2019-01-18 12:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206869  13 58501 45751041 A  ERRORERROR'
2019-01-18 12:42:31 [DEBUG   ] Got command RPT from MCS: ref #1206870
2019-01-18 12:42:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206870  77 58501 45751245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:42:31 [DEBUG   ] Got command RPT from MCS: ref #1206871
2019-01-18 12:42:31 [DEBUG   ] summary = ERROR
2019-01-18 12:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206871  13 58501 45751449 A  ERRORERROR'
2019-01-18 12:42:31 [DEBUG   ] Got command RPT from MCS: ref #1206872
2019-01-18 12:42:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206872  77 58501 45751641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:42:31 [DEBUG   ] Got command RPT from MCS: ref #1206873
2019-01-18 12:42:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206873  12 58501 45751845 A  ERRORB™™š'
2019-01-18 12:42:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:42:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:43:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:43:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:43:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:43:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:43:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:43:30 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-01-18 12:43:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:43:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:44:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:44:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:44:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:44:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:44:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:44:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:44:30 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-18 12:44:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:44:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 12:45:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:45:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:45:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:45:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:45:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:45:30 [DEBUG   ] Finished updating board flags in 1.447 seconds
2019-01-18 12:45:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:45:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:46:05 [DEBUG   ] Got command RPT from MCS: ref #1206882
2019-01-18 12:46:05 [DEBUG   ] summary = ERROR
2019-01-18 12:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206882  13 58501 45965961 A  ERRORERROR'
2019-01-18 12:46:05 [DEBUG   ] Got command RPT from MCS: ref #1206883
2019-01-18 12:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206883  77 58501 45965962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:46:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 12:46:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:46:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:46:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:46:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:46:30 [WARNING ] (13, 1, 'bot')
2019-01-18 12:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:46:30 [DEBUG   ] Finished updating board flags in 1.554 seconds
2019-01-18 12:46:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 12:46:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 12:47:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:47:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:47:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:47:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:47:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:47:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:47:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:47:31 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-18 12:47:31 [DEBUG   ] Got command RPT from MCS: ref #1206901
2019-01-18 12:47:31 [DEBUG   ] summary = ERROR
2019-01-18 12:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206901  13 58501 46051129 A  ERRORERROR'
2019-01-18 12:47:31 [DEBUG   ] Got command RPT from MCS: ref #1206902
2019-01-18 12:47:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206902  77 58501 46051321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:47:31 [DEBUG   ] Got command RPT from MCS: ref #1206903
2019-01-18 12:47:31 [DEBUG   ] summary = ERROR
2019-01-18 12:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206903  13 58501 46051525 A  ERRORERROR'
2019-01-18 12:47:31 [DEBUG   ] Got command RPT from MCS: ref #1206905
2019-01-18 12:47:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206905  77 58501 46051729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:47:31 [DEBUG   ] Got command RPT from MCS: ref #1206907
2019-01-18 12:47:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206907  12 58501 46051921 A  ERRORB˜™š'
2019-01-18 12:47:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 12:47:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 12:48:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-18 12:48:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:48:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-18 12:48:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:48:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:48:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:48:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:48:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:48:31 [DEBUG   ] Finished updating board flags in 2.133 seconds
2019-01-18 12:48:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 12:48:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:49:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:49:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:49:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:49:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:49:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:49:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:49:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:49:31 [DEBUG   ] Finished updating board flags in 1.889 seconds
2019-01-18 12:49:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:49:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:50:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 12:50:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:50:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:50:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:50:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:50:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:50:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:50:31 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-01-18 12:50:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 12:50:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:51:05 [DEBUG   ] Got command RPT from MCS: ref #1206915
2019-01-18 12:51:05 [DEBUG   ] summary = ERROR
2019-01-18 12:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206915  13 58501 46265961 A  ERRORERROR'
2019-01-18 12:51:05 [DEBUG   ] Got command RPT from MCS: ref #1206916
2019-01-18 12:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206916  77 58501 46265962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:51:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:51:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:51:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:51:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:51:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:51:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:51:31 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-01-18 12:51:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 12:51:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 12:52:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:52:31 [DEBUG   ] Got command RPT from MCS: ref #1206936
2019-01-18 12:52:31 [DEBUG   ] summary = ERROR
2019-01-18 12:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206936  13 58501 46351201 A  ERRORERROR'
2019-01-18 12:52:31 [DEBUG   ] Got command RPT from MCS: ref #1206937
2019-01-18 12:52:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206937  77 58501 46351410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:52:31 [DEBUG   ] Got command RPT from MCS: ref #1206938
2019-01-18 12:52:31 [DEBUG   ] summary = ERROR
2019-01-18 12:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206938  13 58501 46351606 A  ERRORERROR'
2019-01-18 12:52:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:52:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:52:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:52:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:52:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:52:31 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-18 12:52:31 [DEBUG   ] Got command RPT from MCS: ref #1206939
2019-01-18 12:52:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206939  77 58501 46351809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:52:32 [DEBUG   ] Got command RPT from MCS: ref #1206940
2019-01-18 12:52:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206940  12 58501 46352013 A  ERRORB™™š'
2019-01-18 12:52:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:52:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 12:53:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 12:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:53:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 12:53:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:53:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:53:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:53:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:53:31 [DEBUG   ] Finished updating board flags in 1.661 seconds
2019-01-18 12:53:38 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2019-01-18 12:53:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-18 12:54:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-18 12:54:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 12:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:54:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:54:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:54:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:54:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:54:31 [DEBUG   ] Finished updating board flags in 1.575 seconds
2019-01-18 12:54:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 12:54:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 12:55:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 12:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:55:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:55:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:55:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:55:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:55:31 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-18 12:55:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 12:55:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 12:56:05 [DEBUG   ] Got command RPT from MCS: ref #1206945
2019-01-18 12:56:05 [DEBUG   ] summary = ERROR
2019-01-18 12:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206945  13 58501 46565961 A  ERRORERROR'
2019-01-18 12:56:05 [DEBUG   ] Got command RPT from MCS: ref #1206946
2019-01-18 12:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206946  77 58501 46565962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:56:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 12:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:56:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:56:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:56:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:56:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:56:31 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-18 12:56:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 12:56:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:57:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 12:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:57:31 [DEBUG   ] Got command RPT from MCS: ref #1206964
2019-01-18 12:57:31 [DEBUG   ] summary = ERROR
2019-01-18 12:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206964  13 58501 46651281 A  ERRORERROR'
2019-01-18 12:57:31 [DEBUG   ] Got command RPT from MCS: ref #1206965
2019-01-18 12:57:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206965  77 58501 46651486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:57:31 [DEBUG   ] Got command RPT from MCS: ref #1206966
2019-01-18 12:57:31 [DEBUG   ] summary = ERROR
2019-01-18 12:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206966  13 58501 46651689 A  ERRORERROR'
2019-01-18 12:57:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:57:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:57:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:57:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:57:31 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-01-18 12:57:31 [DEBUG   ] Got command RPT from MCS: ref #1206968
2019-01-18 12:57:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 12:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206968  77 58501 46651881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 12:57:32 [DEBUG   ] Got command RPT from MCS: ref #1206970
2019-01-18 12:57:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 12:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206970  12 58501 46652085 A  ERRORB™™š'
2019-01-18 12:57:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 12:57:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 12:58:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 12:58:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:58:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:58:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:58:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:58:31 [WARNING ] (13, 1, 'bot')
2019-01-18 12:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:58:31 [DEBUG   ] Finished updating board flags in 1.561 seconds
2019-01-18 12:58:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-18 12:58:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 12:59:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:59:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 12:59:32 [WARNING ] (13, 1, 'bot')
2019-01-18 12:59:32 [WARNING ] (13, 1, 'bot')
2019-01-18 12:59:32 [WARNING ] (13, 1, 'bot')
2019-01-18 12:59:32 [WARNING ] (13, 1, 'bot')
2019-01-18 12:59:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 12:59:32 [DEBUG   ] Finished updating board flags in 2.176 seconds
2019-01-18 12:59:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 12:59:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 13:00:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 13:00:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:00:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:00:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:00:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:00:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:00:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 13:00:32 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-18 13:00:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-18 13:00:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 13:01:05 [DEBUG   ] Got command RPT from MCS: ref #1206982
2019-01-18 13:01:05 [DEBUG   ] summary = ERROR
2019-01-18 13:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206982  13 58501 46865965 A  ERRORERROR'
2019-01-18 13:01:05 [DEBUG   ] Got command RPT from MCS: ref #1206983
2019-01-18 13:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206983  77 58501 46865966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:01:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 13:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:01:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:01:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:01:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:01:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:01:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 13:01:32 [DEBUG   ] Finished updating board flags in 1.830 seconds
2019-01-18 13:01:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 13:01:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-18 13:02:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 13:02:31 [DEBUG   ] Got command RPT from MCS: ref #1206999
2019-01-18 13:02:31 [DEBUG   ] summary = ERROR
2019-01-18 13:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1206999  13 58501 46951365 A  ERRORERROR'
2019-01-18 13:02:31 [DEBUG   ] Got command RPT from MCS: ref #1207000
2019-01-18 13:02:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207000  77 58501 46951570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:02:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:02:31 [DEBUG   ] Got command RPT from MCS: ref #1207001
2019-01-18 13:02:31 [DEBUG   ] summary = ERROR
2019-01-18 13:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207001  13 58501 46951761 A  ERRORERROR'
2019-01-18 13:02:31 [DEBUG   ] Got command RPT from MCS: ref #1207002
2019-01-18 13:02:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207002  77 58501 46951965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:02:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-18 13:02:32 [DEBUG   ] Got command RPT from MCS: ref #1207003
2019-01-18 13:02:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 13:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207003  12 58501 46952169 A  ERRORB”™š'
2019-01-18 13:02:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:02:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:02:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:02:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:02:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 13:02:32 [DEBUG   ] Finished updating board flags in 1.745 seconds
2019-01-18 13:02:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 13:02:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 13:03:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-18 13:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:03:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:03:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:03:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:03:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 13:03:32 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-18 13:03:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-18 13:03:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-18 13:04:20 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-18 13:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:04:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:04:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:04:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:04:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:04:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 13:04:32 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-18 13:04:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-18 13:05:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 13:05:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-18 13:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:05:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:05:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:05:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:05:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:05:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 13:05:32 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-18 13:05:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 13:06:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 13:06:05 [DEBUG   ] Got command RPT from MCS: ref #1207008
2019-01-18 13:06:05 [DEBUG   ] summary = ERROR
2019-01-18 13:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207008  13 58501 47165969 A  ERRORERROR'
2019-01-18 13:06:05 [DEBUG   ] Got command RPT from MCS: ref #1207009
2019-01-18 13:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207009  77 58501 47165970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:06:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 13:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:06:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:06:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:06:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:06:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-18 13:06:32 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-18 13:06:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 13:07:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-18 13:07:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 99634383
2019-01-18 13:07:31 [DEBUG   ] Got command RPT from MCS: ref #1207031
2019-01-18 13:07:31 [DEBUG   ] summary = ERROR
2019-01-18 13:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207031  13 58501 47251442 A  ERRORERROR'
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 99634383
2019-01-18 13:07:31 [DEBUG   ] Got command RPT from MCS: ref #1207032
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 99634383
2019-01-18 13:07:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 99634383
2019-01-18 13:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207032  77 58501 47251646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 99634383
2019-01-18 13:07:31 [DEBUG   ] Got command RPT from MCS: ref #1207033
2019-01-18 13:07:31 [DEBUG   ] summary = ERROR
2019-01-18 13:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207033  13 58501 47251849 A  ERRORERROR'
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 99634383
2019-01-18 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2019-01-18 13:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 99634383
2019-01-18 13:07:32 [DEBUG   ] Got command RPT from MCS: ref #1207035
2019-01-18 13:07:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207035  77 58501 47252041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 99634383
2019-01-18 13:07:32 [DEBUG   ] Got command RPT from MCS: ref #1207037
2019-01-18 13:07:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 13:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207037  12 58501 47252245 A  ERRORB”™š'
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 99634383
2019-01-18 13:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2019-01-18 13:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 99634383
2019-01-18 13:07:32 [WARNING ] (2, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (2, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (2, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (2, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (2, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (3, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (4, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (5, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (8, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (8, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (8, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (8, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (9, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (9, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (9, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (9, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (10, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (11, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (11, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (11, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (11, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (12, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (12, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (13, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (14, 2, 'top')
2019-01-18 13:07:32 [WARNING ] (14, 2, 'top')
2019-01-18 13:07:32 [WARNING ] (14, 2, 'top')
2019-01-18 13:07:32 [WARNING ] (14, 2, 'top')
2019-01-18 13:07:32 [WARNING ] (14, 4, 'bot')
2019-01-18 13:07:32 [WARNING ] (14, 4, 'bot')
2019-01-18 13:07:32 [WARNING ] (14, 4, 'bot')
2019-01-18 13:07:32 [WARNING ] (14, 4, 'bot')
2019-01-18 13:07:32 [WARNING ] (16, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (16, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (16, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (16, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (17, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (18, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (19, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (19, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (19, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (19, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (19, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (19, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (19, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (19, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (20, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (20, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (20, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (20, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (20, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (20, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (20, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (20, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (21, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (21, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (21, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (21, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (22, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (22, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (22, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (22, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (22, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (22, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (22, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (22, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'top')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (24, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 1, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (26, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (27, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (27, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (27, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (27, 1, 'top')
2019-01-18 13:07:32 [WARNING ] (28, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (28, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (28, 5, 'bot')
2019-01-18 13:07:32 [WARNING ] (28, 5, 'bot')
2019-01-18 13:07:32 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:07:32 [DEBUG   ] Finished updating board flags in 1.462 seconds
2019-01-18 13:07:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 13:08:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 13:08:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2019-01-18 13:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2019-01-18 13:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2019-01-18 13:08:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:08:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:08:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:08:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:08:32 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:08:32 [DEBUG   ] Finished updating board flags in 1.440 seconds
2019-01-18 13:08:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 13:09:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 13:09:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 13:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:09:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:09:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:09:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:09:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:09:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:09:32 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:09:32 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-18 13:09:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 13:10:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 13:10:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 13:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:10:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:10:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-18 13:10:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 13:10:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:10:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:10:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:10:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:10:32 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:10:32 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-18 13:10:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 13:11:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-18 13:11:05 [DEBUG   ] Got command RPT from MCS: ref #1207045
2019-01-18 13:11:05 [DEBUG   ] summary = ERROR
2019-01-18 13:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207045  13 58501 47465973 A  ERRORERROR'
2019-01-18 13:11:05 [DEBUG   ] Got command RPT from MCS: ref #1207046
2019-01-18 13:11:05 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207046  98 58501 47465974 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:11:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 13:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:11:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-18 13:11:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:11:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:11:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:11:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:11:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:11:32 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:11:32 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-18 13:11:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 13:12:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-18 13:12:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 13:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:12:31 [DEBUG   ] Got command RPT from MCS: ref #1207062
2019-01-18 13:12:31 [DEBUG   ] summary = ERROR
2019-01-18 13:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207062  13 58501 47551529 A  ERRORERROR'
2019-01-18 13:12:31 [DEBUG   ] Got command RPT from MCS: ref #1207063
2019-01-18 13:12:31 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207063  98 58501 47551722 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:12:31 [DEBUG   ] Got command RPT from MCS: ref #1207064
2019-01-18 13:12:31 [DEBUG   ] summary = ERROR
2019-01-18 13:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207064  13 58501 47551930 A  ERRORERROR'
2019-01-18 13:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:12:32 [DEBUG   ] Got command RPT from MCS: ref #1207065
2019-01-18 13:12:32 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207065  98 58501 47552126 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:12:32 [DEBUG   ] Got command RPT from MCS: ref #1207066
2019-01-18 13:12:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 13:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207066  12 58501 47552333 A  ERRORB•™š'
2019-01-18 13:12:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-18 13:12:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:12:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:12:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:12:32 [WARNING ] (13, 1, 'bot')
2019-01-18 13:12:32 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:12:32 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-18 13:12:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 13:13:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 13:13:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-18 13:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:13:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 13:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:13:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:13:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:13:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:13:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:13:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:13:33 [DEBUG   ] Finished updating board flags in 2.217 seconds
2019-01-18 13:13:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 13:14:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-18 13:14:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 13:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:14:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 13:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:14:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:14:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:14:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:14:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:14:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:14:33 [DEBUG   ] Finished updating board flags in 2.170 seconds
2019-01-18 13:14:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-18 13:15:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-18 13:15:22 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2019-01-18 13:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:15:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-18 13:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:15:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:15:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:15:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:15:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:15:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:15:33 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-18 13:15:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 13:16:02 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-18 13:16:05 [DEBUG   ] Got command RPT from MCS: ref #1207075
2019-01-18 13:16:05 [DEBUG   ] summary = ERROR
2019-01-18 13:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207075  13 58501 47765969 A  ERRORERROR'
2019-01-18 13:16:05 [DEBUG   ] Got command RPT from MCS: ref #1207076
2019-01-18 13:16:05 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207076  98 58501 47765970 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:16:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-18 13:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:16:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 13:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:16:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:16:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:16:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:16:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:16:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:16:33 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-18 13:16:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-18 13:17:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-18 13:17:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 13:17:31 [DEBUG   ] Got command RPT from MCS: ref #1207094
2019-01-18 13:17:31 [DEBUG   ] summary = ERROR
2019-01-18 13:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207094  13 58501 47851609 A  ERRORERROR'
2019-01-18 13:17:31 [DEBUG   ] Got command RPT from MCS: ref #1207095
2019-01-18 13:17:31 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207095  98 58501 47851801 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:17:32 [DEBUG   ] Got command RPT from MCS: ref #1207096
2019-01-18 13:17:32 [DEBUG   ] summary = ERROR
2019-01-18 13:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207096  13 58501 47852011 A  ERRORERROR'
2019-01-18 13:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:17:32 [DEBUG   ] Got command RPT from MCS: ref #1207098
2019-01-18 13:17:32 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207098  98 58501 47852204 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:17:32 [DEBUG   ] Got command RPT from MCS: ref #1207100
2019-01-18 13:17:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 13:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207100  12 58501 47852405 A  ERRORB‡ÌÍ'
2019-01-18 13:17:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:17:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:17:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:17:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:17:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:17:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:17:33 [DEBUG   ] Finished updating board flags in 1.837 seconds
2019-01-18 13:17:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-18 13:18:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-18 13:18:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-18 13:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:18:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:18:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:18:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:18:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:18:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:18:33 [DEBUG   ] Finished updating board flags in 1.772 seconds
2019-01-18 13:18:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-18 13:19:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-18 13:19:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-18 13:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:19:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:19:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:19:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:19:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:19:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:19:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:19:33 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-18 13:19:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-18 13:20:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 13:20:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 13:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:20:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:20:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:20:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:20:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:20:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:20:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:20:33 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-18 13:20:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-18 13:21:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-18 13:21:05 [DEBUG   ] Got command RPT from MCS: ref #1207108
2019-01-18 13:21:05 [DEBUG   ] summary = ERROR
2019-01-18 13:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207108  13 58501 48065973 A  ERRORERROR'
2019-01-18 13:21:05 [DEBUG   ] Got command RPT from MCS: ref #1207109
2019-01-18 13:21:05 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207109  98 58501 48065974 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:21:23 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-18 13:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:21:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:21:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:21:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:21:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:21:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:21:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:21:33 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-18 13:21:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-18 13:22:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-18 13:22:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-18 13:22:31 [DEBUG   ] Got command RPT from MCS: ref #1207129
2019-01-18 13:22:31 [DEBUG   ] summary = ERROR
2019-01-18 13:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207129  13 58501 48151685 A  ERRORERROR'
2019-01-18 13:22:31 [DEBUG   ] Got command RPT from MCS: ref #1207130
2019-01-18 13:22:31 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207130  98 58501 48151889 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:22:32 [DEBUG   ] Got command RPT from MCS: ref #1207131
2019-01-18 13:22:32 [DEBUG   ] summary = ERROR
2019-01-18 13:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207131  13 58501 48152081 A  ERRORERROR'
2019-01-18 13:22:32 [DEBUG   ] Got command RPT from MCS: ref #1207132
2019-01-18 13:22:32 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-18 13:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207132  98 58501 48152285 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-18 13:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:22:32 [DEBUG   ] Got command RPT from MCS: ref #1207133
2019-01-18 13:22:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-18 13:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1207133  12 58501 48152489 A  ERRORB…ÌÍ'
2019-01-18 13:22:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:22:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:22:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:22:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:22:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:22:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:22:33 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-18 13:22:43 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-18 13:23:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 13:23:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-18 13:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:23:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-18 13:23:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:23:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:23:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:23:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:23:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:23:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:23:33 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-18 13:23:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 13:24:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 13:24:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-18 13:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999717
2019-01-18 13:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999717
2019-01-18 13:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999718
2019-01-18 13:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999717
2019-01-18 13:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999717
2019-01-18 13:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-18 13:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195614544
2019-01-18 13:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195614358
2019-01-18 13:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195614243
2019-01-18 13:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195614392
2019-01-18 13:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195614246
2019-01-18 13:24:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:24:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:24:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:24:33 [WARNING ] (13, 1, 'bot')
2019-01-18 13:24:33 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2019-01-18 13:24:33 [DEBUG   ] Finished updating board flags in 1.504 seconds
2019-01-18 13:24:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
